Serving Chain-structured Jobs with Large Memory Footprints with Application to Large Foundation Model Serving

arXiv:2604.14993 · cs.DC, cs.PF · Submitted 2026-04-16 · Read on arXiv

cs.DC, cs.PF

Submitted: 2026-04-16

Updated: 2026-11-03

Code: https://github.com/TingyangSunJeff/load_balance_llm_simulator

Terminology

Sources

Related papers