Exact Fusion of Softmax Attention Heads Can Require Exponentially Many Atoms

arXiv:2611.02943 · cs.LG, cs.NE, stat.ML · Submitted 2026-11-02 · Read on arXiv

cs.LG, cs.NE, stat.ML

Submitted: 2026-11-02

Updated: 2026-11-02

Code: https://github.com/usamihiroyasu/attention-head-fusion

Terminology

Sources

Related papers