Verify Before You Fetch: Reliable KV Cache Compression for LLM Inference
cs.AI
Submitted: 2026-11-08
Updated: 2026-11-08
Code: https://github.com/epsilon-prime/verifiedKV
Project page: https://epsilon-prime.github.io
Terminology
Sources
- Coding Agents are Effective Long-Context Processors
- Compactor: Calibrated Query-Agnostic KV Cache Compression with Approximate Leverage Scores
- The Horizon Gap: Planning, Memory, Execution, Training, and Evaluation for Long-Horizon LLM Agents
- Deep Learning-based Software Engineering: Progress, Challenges, and Opportunities
- SOCKET: SOft Collision Kernel EsTimator for Sparse Attention
- Fast KVzip: Efficient and Accurate LLM Inference with Gated KV Eviction
- Can Long-Context Language Models Subsume Retrieval, RAG, SQL, and More?
- SnapKV: LLM Knows What You are Looking for Before Generation
- Ministral 3
- Qwen3 Technical Report
Related papers
- Multi-Objective Structured Pruning of LLMs for Latency and Model Size Optimization
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Embeddings for Preferences, Not Semantics
- Can We Trust Item Response Theory for AI Evaluation?
- Diagnosing Task Insensitivity in Language Agents