GlitchPatch2 min read
GlitchPatch: Repairing Glitch Tokens in Frozen Language Models via Local Retokenization
Glitch tokens are anomalous vocabulary entries that can cause large language models (LLMs) to produce outputs inconsistent with their inputs. Existing repair methods require access to model internals, making them impractical for frozen checkpoints.
By Kunsheng Tang, Peigui Qi, Yide Song, Peijun Huang, Weiming Zhang, Nenghai YuarXiv - cs.CL (NLP)
Read the full story
Originally published by arXiv - cs.CL (NLP) on Oct 6, 2026.
Comments
Sign in to join the discussion.