RoCoKV: Accelerating LLM Inference Serving through Uncertainty and Redundancy Aware KV Cache Compression

arXiv:2611.25433 · cs.CL · Submitted 2026-11-19 · Read on arXiv

cs.CL

Submitted: 2026-11-19

Updated: 2026-11-19

Terminology

Related papers