Fairway: Load-Aware KV Cache Reuse for LLM Prefill Scheduling

arXiv:2611.02082 · cs.DC · Submitted 2026-11-01 · Read on arXiv

cs.DC

Submitted: 2026-11-01

Updated: 2026-11-01

Code: https://github.com/docugami/KG-RAG-datasets

License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/

Terminology

Sources

Related papers