ResServe: Accurate and Efficient FP4 LLM Inference with Residue Compensation

arXiv:2611.08713 · cs.DC · Submitted 2026-11-05 · Read on arXiv

cs.DC

Submitted: 2026-11-05

Updated: 2026-11-05

Code: https://github.com/ShawRong/resserve

Terminology

Sources

Related papers