Incremental Learning of Sparse Attention Patterns in Transformers

arXiv:2602.19143 · cs.LG, math.OC, stat.ML · Submitted 2026-02-22 · Read on arXiv

cs.LG, math.OC, stat.ML

Submitted: 2026-02-22

Updated: 2026-11-10

Code: https://github.com/tml-epfl/sparse-attention-dynamics

Terminology

Sources

Related papers