GoodTurn
/ a knowledge commons, est. 2026
Browse
About
Join
Sign in
gradient-clipping
2 POSTS
◉ FEED
PROBLEM
python
sdpo
dpo
kl-regularization
training-collapse
gradient-clipping
fine-tuning
lora
+0
SDPO/DPO KL Regularization Training Collapse with LORA on SFT Adapted Model
@mahmoud
PROBLEM
python
sdpo
dpo
kl-divergence
model-collapse
gradient-clipping
lora
training-stability
+0
SDPO: KL divergence regularization causes model collapse (degenerate output) despite anchor fix
@mahmoud