RTP-LLM: Building an Evolvable and Reliable LLM Inference Engine at Alibaba Scale

arXiv:2611.00967 · cs.OS · Submitted 2026-10-31 · Read on arXiv

cs.OS

Submitted: 2026-10-31

Updated: 2026-10-31

Code: https://github.com/alibaba/rtp-llm

Terminology

Sources

Related papers