FusionEval: Benchmarking Model Fusion for Large Language Models
Model fusion aims to integrate the capabilities of multi-expert models into a single model. Existing evaluations offer limited coverage of reasoning with long chains of thought and tool use, while strong average performance can mask substantial losses in individual expert capabilities.
arXiv - cs.CL (NLP)2 min read