Context Is Not Free: Carbon-Aware LLM Routing for Multi-Turn LLM Web Services across Geo-Distributed Data Centers
cs.DC, cs.AI, cs.CY
Submitted: 2026-10-26
Updated: 2026-10-26
Related papers
- iScheduler: Reinforcement Learning-Driven Continual Optimization for Large-Scale Resource Investment Problems
- Load Balancing with Evolving Workloads in Large-Scale Language Model Serving
- Dooly: Configuration-Agnostic, Redundancy-Aware Profiling for LLM Inference Simulation
- SAMM: Sharded Automated Market Maker
- InferScale: GPU-Native KV Injection for Personalized LLM Serving
- Vigil: Accountable Liveness against Selective Silence