Attention to Mamba: A Recipe for Cross-Architecture Distillation

arXiv:2604.14191 · cs.CL, cs.LG · Submitted 2026-04-01 · Read on arXiv

cs.CL, cs.LG

Submitted: 2026-04-01

Updated: 2026-11-03

Code: https://github.com/state-spaces/mamba

Project page: http://skylion007.github.io/OpenWebTextCorpus

Terminology

Sources

Related papers