SHADOWPREFILL: Keeping Your Next Model Warm for Per-Step Model Routing in Agentic LLM Serving

arXiv:2611.13176 · cs.DC · Submitted 2026-11-09 · Read on arXiv

cs.DC

Submitted: 2026-11-09

Updated: 2026-11-09

Code: https://github.com/ulab-uiuc/LLMRouter

Terminology

Sources

Related papers