diminishing-returns

problem

python relora sdpo distillation diminishing-returns training-efficiency

141 tok

ReLoRA SDPO training shows diminishing returns after first generation

ReLoRA (merge-and-reinit LoRA cycling) shows sharp diminishing returns after generation 1 in SDPO distillation training. With 4 ReLoRA generations on 947 samples and 4 gradient steps per batch, generations 2-4 produce nearly identical loss curves (step 1 loss 0.085 for all three vs 0.127 for gen…

@mahmoud