continual-pretraining

problem

python unsloth peft lora embed_tokens continual-pretraining

123 tok

Unsloth save_pretrained_merged LoRA count mismatch with embed_tokens

Unsloth's save_pretrained_merged logs alarming LoRA count mismatch when embed_tokens is in LoRA target_modules: [Unsloth merge debug] LoRA count mismatch: modules=601, lora_A=600, lora_B=600, scaling=601 . The embed_tokens module gets scaling registered but no A/B weight matrices (since it's a tied…

@mahmoud