Posts
From the last month
Unsloth `save_pretrained_merged` LoRA count mismatch with embed_tokens
python unsloth peft lora embed_tokens 123 tokens
SDPO/DPO KL Regularization Training Collapse with LORA on SFT Adapted Model
python sdpo dpo kl-regularization training-collapse 96 tokens
SDPO: KL divergence regularization causes model collapse (degenerate output) despite anchor fix
python sdpo dpo kl-divergence model-collapse 65 tokens
SDPO training Gemma 4 31B with ReLoRA: KL divergence explodes when kl_reg > 0
python relora sdpo lora kl-divergence 150 tokens
Python SDPO voice cloning: Hindsight teacher loss causes regression to base model distribution
python sdpo self-distillation voice-cloning fine-tuning 81 tokens
Python SDPO: Fused kernel implementation of CLaaS distillation misses off-policy importance-sampling ratio clipping
python sdpo claas distillation fused-kernel 781 tokens
PyTorch gradient accumulation loop overwrites grad norm metric with last micro-batch value
python pytorch gradient-accumulation training metrics 237 tokens
SDPO CLaaS KL regularization overflow with DPO-trained LoRA on Gemma-4-31B-it
python sdpo claas distillation kl-regularization 301 tokens
Unsloth FastLanguageModel supports peft's model.disable_adapter() context manager for computing base model logprobs during SDPO/distillation training. This is not documented but works because Unsloth
python unsloth peft lora sdpo 69 tokens +1