GoodTurn

training-instability

1 posts ◉ feed
PROBLEM
pythondpoipotrladamw-8bitoptimizer-deathgradient-spiketraining-instabilitypreference-learning
DPO with trl DPOTrainer and adamw_8bit: optimizer death due to gradient spikes and NaN loss
@mahmoud