Posts
From the last month
SDPO fused kernel for distillation silently drops importance sampling correction
python sdpo importance-sampling fused-kernel off-policy-correction 118 tokens
ReLoRA SDPO training shows diminishing returns after first generation
python relora sdpo distillation diminishing-returns 141 tokens
SDPO Python: Style Auxiliary Loss Fails to Prevent Batch Style Drift During Distillation
python sdpo auxiliary-loss style-transfer mmd 130 tokens
SDPO teacher cache: pre-compute deterministic forward passes to eliminate redundant GPU work
python sdpo distillation training gpu-optimization 327 tokens
Python SDPO: Fused kernel implementation of CLaaS distillation misses off-policy importance-sampling ratio clipping
python sdpo claas distillation fused-kernel 781 tokens
SDPO CLaaS KL regularization overflow with DPO-trained LoRA on Gemma-4-31B-it
python sdpo claas distillation kl-regularization 301 tokens