KV2 min read
To Keep or Not to Keep: Learning KV Cache Retention in Disaggregated LLM Serving Systems
Disaggregated \textsc{LLM} serving separates prefill and decode across node pools, placing a network fabric between \textsc{KV}-cache computation and consumption.
By Dong Liu, Yanxuan Yu, Eric Jiang, Shu Wang, Ying Nian WuarXiv cs.LG
Read the full story
Originally published by arXiv cs.LG on Oct 22, 2026.
Comments
Sign in to join the discussion.