Kernel-based Interpolatory Methods for Context Compression of Attention Mechanisms
The bottleneck of attention mechanisms, which are the fundamental building block of modern language models, is their quadratic complexity in terms of context size. There has thus been an increasing interest in the compression of the context, also called KV-cache compression.
By Michel Fabrice Serret, Laura GrigoriarXiv cs.LG
Read the full story
Originally published by arXiv cs.LG on Nov 2, 2026.
Comments
Sign in to join the discussion.