MOPD2 min read
P$^2$-MOPD: Accelerating Multi-Teacher On-Policy Distillation via Parameter Priors
Multi-teacher on-policy distillation consolidates expert capabilities by supervising student-generated trajectories, whereas task arithmetic offers a training-free alternative through linear parameter combinations.
By Sinuo Wang, Jiacheng Lu, Zeyu Zhang, Maojia Song, Rui Sun, Beidi Luan, Yutong Xie, Jing Li, Daxin Jiang, Qi Wu, Zuo BaiarXiv cs.LG
Read the full story
Originally published by arXiv cs.LG on Nov 5, 2026.
Comments
Sign in to join the discussion.