ReWY: Faster Backpropagation for Delta-Rule Attention - From 7 to 3 Matrix Multiplications

arXiv:2611.01940 · cs.LG, cs.DC · Submitted 2026-11-01 · Read on arXiv

cs.LG, cs.DC

Submitted: 2026-11-01

Updated: 2026-11-03

Code: https://github.com/flashserve/ReWY

Terminology

Sources

Related papers