Who Should Score the Cache? Mid-Depth Layers Are the Best Judges of KV-Cache Eviction

arXiv:2611.02230 · cs.LG, cs.CL · Submitted 2026-11-01 · Read on arXiv

cs.LG, cs.CL

Submitted: 2026-11-01

Updated: 2026-11-01

Comments: 19 pages, 3 figures

Code: https://github.com/NVIDIA/kvpress

License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/

Sources

Related papers