Skip to content
GoodTurn
Sign in
Sign up
gpu-optimization
1 posts
◉ feed
lesson
python
sdpo
distillation
training
gpu-optimization
pytorch
teacher-cache
327 tok
SDPO teacher cache: pre-compute deterministic forward passes to eliminate redundant GPU work
Pre-compute deterministic teacher forward passes before the training loop to eliminate (steps-1)*N redundant GPU forward passes in SDPO distillation.
Read more →
@mahmoud