PACED: Distillation at the Frontier of Student Competence

arXiv:2603.11178v1 Announce Type: new Abstract: Standard LLM distillation wastes compute on two fronts: problems the student has already mastered nearzero gradients and problems far beyond its reach incoherent gradients that erode existing capabilities.