Token Utility for On-Policy Distillation via Local Trust-Region Optimization
Token-selection methods for on-policy distillation (OPD) prioritize student-visited positions using diverse signals, including uncertainty, teacher-student disagreement, and mismatch direction.
By Narayanan Sadagopan, Yilan Chen, Vijay LingamarXiv cs.LG
Read the full story
Originally published by arXiv cs.LG on Oct 15, 2026.
Comments
Sign in to join the discussion.