Better Supervision Is Nearby: Neighborhood On-Policy Self-Distillation
Neighborhood OPSD improves mathematical reasoning models by using a privileged teacher and leveraging corrections from nearby parameter settings. It finds that local parameter perturbations reveal complementary reference-aligned corrections, which are pooled and routed online to provide richer supervision than a single fixed teacher setting.