LEGO-OPD: Factorized Teacher Composition for Multimodal On-Policy Distillation
Multimodal on-policy distillation (OPD) aims to improve visual grounding while preserving the strong reasoning capabilities of language models. Recent multi-teacher approaches combine LLM and VLM teachers to provide complementary supervision.
arXiv - cs.CV (CV)2 min read