Multi-Turn Semantic Caching for Low-Cost LLM Serving

arXiv:2611.01077 · cs.LG, cs.CL, cs.DC · Submitted 2026-10-31 · Read on arXiv

cs.LG, cs.CL, cs.DC

Submitted: 2026-10-31

Updated: 2026-11-08

License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/

Terminology

Sources

Related papers