BitLLM: Efficient Low-Bit, Conversion-Hiding LLM Decoding on Mobile GPUs

arXiv:2611.00547 · cs.AR, cs.LG, cs.OS, cs.PF · Submitted 2026-10-31 · Read on arXiv

cs.AR, cs.LG, cs.OS, cs.PF

Submitted: 2026-10-31

Updated: 2026-10-31

Code: https://github.com/NVIDIA/FasterTransformer

Terminology

Sources

Related papers