LazyWeights: Decode-on-Demand Edge LLMs

arXiv:2611.17108 · cs.LG, cs.AR, cs.CL, cs.IT, math.IT · Submitted 2026-11-12 · Read on arXiv

cs.LG, cs.AR, cs.CL, cs.IT, math.IT

Submitted: 2026-11-12

Updated: 2026-11-18

Code: https://github.com/ggml-org/llama.cpp

Terminology

Sources

Related papers