Weights That Stay: On-Chip Megakernels for Serial Heads in Speculative Decoding

arXiv:2611.00506 · cs.DC, cs.LG · Submitted 2026-10-31 · Read on arXiv

cs.DC, cs.LG

Submitted: 2026-10-31

Updated: 2026-10-31

Code: https://github.com/tatsu-lab/stanford_alpaca

Terminology

Sources

Related papers