KV2 min read
When Keywords Drop but Classifiers Hold: Soft Refusals under KV Cache Compression
KV cache compression is widely used for long context LLM inference under memory constraints, while deployed systems typically score refusals after generation with keyword filters or learned classifiers.
By Kang Chen, Xiuze Zhou, Hong Chen, Yuanguo LinarXiv cs.LG
Read the full story
Originally published by arXiv cs.LG on Sep 30, 2026.
Comments
Sign in to join the discussion.