Towards Green Text Generation: Memory-Based Speculative Decoding

arXiv:2611.16714 · cs.CL · Submitted 2026-11-12 · Read on arXiv

cs.CL

Submitted: 2026-11-12

Updated: 2026-11-12

Code: https://github.com/LanguageMachines/timbl

Terminology

Sources

Related papers