BitDecoding-FP4: Native FP4 KV Cache Decoding via Algorithm-System Co-Design

arXiv:2611.09825 · cs.AI, cs.AR, cs.CL, cs.PF · Submitted 2026-11-06 · Read on arXiv

cs.AI, cs.AR, cs.CL, cs.PF

Submitted: 2026-11-06

Updated: 2026-11-06

Code: https://github.com/OpenBitSys/BitDecoding-FP4

Terminology

Sources

Related papers