Batched Early-Exit LLM Inference Done Right with DREX

arXiv:2512.15705 · cs.DC, cs.LG · Submitted 2025-12-17 · Read on arXiv

cs.DC, cs.LG

Submitted: 2025-12-17

Updated: 2026-11-11

Terminology

Sources

Related papers