Multi-GPU MoE Inference with Adaptive Expert Offloading

arXiv:2611.10219 · cs.AI · Submitted 2026-11-06 · Read on arXiv

cs.AI

Submitted: 2026-11-06

Updated: 2026-11-06

Code: https://github.com/ggml-org/llama.cpp

Terminology

Sources

Related papers