Where Should a KV-Cache Repair Budget Go? Distractor Structure and Contextual Compatibility in Non-Prefix Reuse
cs.CL
Submitted: 2026-11-04
Updated: 2026-11-04
Terminology
Sources
- CacheReforge: Bounded Recovery for Stale KV Caches under Evolving Adapters
- Evaluating the accuracy of KV cache reuse techniques
- LatentRemedy: Efficient Remedy For Non-Prefix KV Cache Reuse in Multi-Agent Systems
- The Llama 3 Herd of Models
- KV-Repurpose: A Testbed for Evaluating Non-Prefix KV-Cache Reuse
- Mistral 7B
- Budgeted Cache Repair for Cross-Context KV-Cache Reuse
- Adaptive KV Cache Reuse for Fast Long-Context LLM Serving
- Contiguity, Not Importance: Budgeted Repair of Stale KV Caches After Document Edits
- AgentKVShift: Efficient KV Cache Reuse for Agentic Memory Systems
- RelaxKV: Recomputation Guided by the Query with Sparse Context Attention for Efficient KV Cache Reuse
- KVShareArena: KV-Cache Reuse Across Contexts and Model Checkpoints
- SemPIC: Learning Semantic Position-Independent KV Caches
- Qwen3 Technical Report
- SAFE-KV: Causal Suffix Repair for Behavior-Preserving Non-Prefix KV Cache Reuse in RAG
Related papers
- ALARM: Audio-Language Alignment for Reasoning Models
- ThinkSum: Probabilistic reasoning over sets using large language models
- Coherence boosting: When your pretrained language model is not paying enough attention
- From Facts to Insights: A Persona-Driven Dual Memory Framework and Dataset for Role-Playing Agents
- Improving General Role-Playing Agents via Psychology-Grounded Reasoning and Role-Aware Policy Optimization
- The Art of Asking: Multilingual Prompt Optimization for Synthetic Data