SeqMoE: Toward Full-Load Performance via Predictive and Graph-Compatible MoE Offloading

arXiv:2609.12978 · cs.OS, cs.AI · Submitted 2026-09-11 · Read on arXiv

cs.OS, cs.AI

Submitted: 2026-09-11

Updated: 2026-09-11

License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/

Terminology

• Mixture-of-Experts (MoE) — 1× in this paper · explained in 7 episodes

Related papers

• MemSpec: Memory-Aware Runtime for Adaptive Draft Scheduling in Speculative Decoding on Edge Devices
• Dynamic Flow, Static Graph: KV Cache Reuse for Efficient LLM Serving on Mobile NPUs
• Vulcan: Instance-specialized, Verifiable Systems Heuristics Through LLM-driven Search
• Planarian: Managing Agent State with Statepoints
• VUDA: Enabling Controlled Spatial Sharing of Graphics and Compute on NVIDIA GPUs
• ActKV: Efficient LLM Agents through Action-Guided KV Cache Management