OmniCast: Interaction-Aware Serving for Real-Time Omni-Modal LLMs

arXiv:2606.22983 · cs.DC · Submitted 2026-06-22 · Read on arXiv

cs.DC

Submitted: 2026-06-22

Updated: 2026-11-01

Code: https://github.com/sgl-project/sglang-omni

Terminology

Sources

Related papers