PDScope: Breaking the Prefill-Decode Seesaw for Memory-Bound MoE Inference
cs.DC
Submitted: 2026-10-29
Updated: 2026-10-29
Comments: accepted by PPoPP'27
License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
Terminology
Related papers
- BatchGen: An Architecture for Scalable and Efficient Batch Inference
- Seamless Reconfiguration for DAG-BFT (Technical Report)
- ELDR: Expert-Locality-Aware Decode Routing for PD-Disaggregated MoE Serving
- iScheduler: Reinforcement Learning-Driven Continual Optimization for Large-Scale Resource Investment Problems
- TIRx: A Unified Tile Primitive ML Compiler Across Heterogeneous Backends
- AgentWeave: Efficient Distributed Agent Serving via Flow Decomposition