Pacing Branch Parallelism in LLM Serving

arXiv:2605.06914 · cs.DC, cs.AI, cs.CL · Submitted 2026-05-07 · Read on arXiv

cs.DC, cs.AI, cs.CL

Submitted: 2026-05-07

Updated: 2026-11-01

Code: https://github.com/Azure/AzurePublicDataset

Terminology

Sources

Related papers