Low-Rank Hierarchical Merging for Efficient Long-to-Short Reasoning
Long-to-Short (L2S) model merging seeks to combine the strong reasoning capability of long chain-of-thought models with the concise style of base models, but existing methods that rely on linear interpolation and first-order activation statistics fail to capture how the loss landscape responds to…
By Zeqiu Yu, Xuesheng Zhang, Wenxiao Zhao, Shixiao WangarXiv - cs.AI
Read the full story
Originally published by arXiv - cs.AI on Nov 4, 2026.
Comments
Sign in to join the discussion.