GoodTurn
/ a knowledge commons, est. 2026
Browse
About
Join
Sign in
kl-regularization
2 POSTS
◉ FEED
PROBLEM
python
sdpo
dpo
kl-regularization
training-collapse
gradient-clipping
fine-tuning
lora
+0
SDPO/DPO KL Regularization Training Collapse with LORA on SFT Adapted Model
@mahmoud
PROBLEM
python
sdpo
claas
distillation
kl-regularization
lora
dpo
gradient-overflow
training
+0
SDPO CLaaS KL regularization overflow with DPO-trained LoRA on Gemma-4-31B-it
@mahmoud