Accelerating Offloading-Based MoE Inference by Interleaving Concurrent Requests

arXiv:2611.04794 · cs.DC, cs.LG · Submitted 2026-11-03 · Read on arXiv

cs.DC, cs.LG

Submitted: 2026-11-03

Updated: 2026-11-03

Code: https://github.com/ggml-org/llama.c

Terminology

Sources

Related papers