The Storage View Of KV Cache: Characterizing Cache Behavior Across LLM Workloads
cs.OS
Submitted: 2026-11-06
Updated: 2026-11-06
Code: https://github.com/langchain-ai/open_
Terminology
Sources
- General Agent Evaluation
- BrowseComp-Plus: A More Fair and Transparent Evaluation Benchmark of Deep-Research Agent
- RAGBench: Explainable Benchmark for Retrieval-Augmented Generation Systems
- SWE-bench: Can Language Models Resolve Real-World GitHub Issues?
- InfiniGen: Efficient Generative Inference of Large Language Models with Dynamic KV Cache Management
- Continuum: Efficient and Robust Multi-Turn LLM Agent Scheduling with KV Cache Time-to-Live
- SnapKV: LLM Knows What You are Looking for Before Generation
- Infinite-LLM: Efficient LLM Service for Long Context with DistAttention and Distributed KVCache
- Parrot: Efficient Serving of LLM-based Applications with Semantic Variable
- A Year in LLM Serving: Workload Evolution, Caching and Load-Balancing
- KVFlow: Efficient Prefix Caching for Accelerating LLM-Based Multi-Agent Workflows
- Qwen3 Technical Report
- AppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding Agents
- BurstGPT: A Real-world Workload Dataset to Optimize LLM Serving Systems
- RAGPulse: An Open-Source RAG Workload Trace to Optimize RAG Serving Systems
- Idleness is Relative: Exploiting Tool-Call Idle Windows for Offloading in Agentic Systems with MORI
- CacheBlend: Fast Large Language Model Serving for RAG with Cached Knowledge Fusion
- H$_2$O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models
- WildChat: 1M ChatGPT Interaction Logs in the Wild