VelServe: Taming Decode Jitters in LLM Inference with Tail-Calibrated Scheduling

arXiv:2611.18392 · cs.AI · Submitted 2026-11-13 · Read on arXiv

cs.AI

Submitted: 2026-11-13

Updated: 2026-11-13

Terminology

Related papers