Peft 0.18.1 crashing when fine-tuning
Hey there, little explorer! Imagine you have a super cool toy robot, like a talking dinosaur! 🦖
Now, you want to teach your dinosaur robot a new trick, like how to sing a song. You have a special "teaching kit" called Peft.
But oh no! When you try to use the newest teaching kit (version 0.18.1) with your dinosaur robot (Gemma), the kit says, "Oopsie! I don't know how to teach this kind of dinosaur!" 💥 It's like the kit only knows how to teach toy cars or blocks, but not your special dinosaur.
So, the teaching kit gets a little confused and stops working. The grown-ups are trying to figure out how to make the kit understand all kinds of toys, even your singing dinosaur! They hope to fix it soon so your robot can learn its new song! 😊
Hi, peft Version: 0.18.1 is crashing when attempting to fine-tune google/gemma-4-E2B. The error msg is shown below. I checked and 0.18.1 is the latest version. Will there be an update soon or is there a workaround? I’d appreciate any help. thanks! ValueError: Target module Gemma4ClippableLinear( (linear): Linear(in_features=768, out_features=768, bias=False) ) is not supported. Currently, only the following modules are supported: `torch.nn.Linear`, `torch.nn.Embedding`, `torch.nn.Conv1d`, `torch.nn.Conv2d`, `torch.nn.Conv3d`, `transformers.pytorch_utils.Conv1D`, `torch.nn.MultiheadAttention.`. 1 post - 1 participant Read full topic
Could not retrieve the full article text.
Read on discuss.huggingface.co →discuss.huggingface.co
https://discuss.huggingface.co/t/peft-0-18-1-crashing-when-fine-tuning/174916Sign in to highlight and annotate this article
Conversation starters
Daily AI Digest
Get the top 5 AI stories delivered to your inbox every morning.
More about
transformerversionupdate
How AI Actually Thinks - Explained So a 13-Year-Old Gets It
Tokens, training, context windows, and temperature — the four concepts that explain everything about large language models. You know how your phone suggests the next word when you’re texting? Type “I’m going to the” and it suggests “store” or “park.” Now imagine that autocomplete was trained on every book, every website, every conversation ever written — and instead of suggesting one word, it could write entire essays, solve math problems, and generate working code. That’s fundamentally what a Large Language Model does. And once you understand four concepts — tokens, training, context windows, and temperature — you’ll know more about how AI works than 95% of people who use it daily. No PhD required. Concept 1: Tokens — How AI Reads AI doesn’t read letters or words the way you do. It reads
Software-update - AutoHotkey 2.0.23
Versie 2.0.23 van AutoHotkey is uitgekomen. Dit programma stelt je in staat om vaak gebruikte toetsaanslagen, handelingen en/of knoppencombo s met toetsenbord en muis in een script achter een sneltoets te zetten, zodat de betreffende handeling in één keer wordt uitgevoerd. Daarbij is het mogelijk om eerder gescripte toetscombinaties van AutoIt2 te converteren naar de scripttaal van AutoHotkey. In deze uitgave zijn de volgende verbeteringen aangebracht: Changes in version 2.0.23
Studying Human Attitudes Towards Robots Through Experience
Building the next generation of robots for successful integration into our homes, offices, and factories is more than just solving the hardware and software problems – we also need to understand how they will be perceived and how they can work effectively with people in those spaces. aspect_ratio In summer 2025, RAI Institute set up a free popup robot experience in the CambridgeSide mall, designed to let people experience state-of-the-art robotics first hand. While news stories about robots and AI are common, with some being overly critical and some overly optimistic, most people have not encountered robots in the flesh (or metal) as it were. With no direct experience, their opinions are largely shaped by pop culture and social media, both of which are more focused on sensational stories i
Knowledge Map
Connected Articles — Knowledge Graph
This article is connected to other articles through shared AI topics and tags.
More in Open Source AI
🔥 sponsors/atilaahmettaner
Advanced TradingView MCP Server for AI-powered market analysis. Real-time crypto & stock screening, technical indicators, Bollinger Band intelligence, and candlestick patterns. Works with Claude Desktop & AI assistants. Multi-exchange support (Binance, KuCoin, Bybit+). Open source trading toolkit. — Trending on GitHub today with 38 new stars.
Discussion
Sign in to join the discussion
No comments yet — be the first to share your thoughts!