Spectral Margins and Memory Routing in Looped Transformers

arXiv:2607.10681 · cs.LG, cs.NE · Submitted 2026-07-12 · Read on arXiv

cs.LG, cs.NE

Submitted: 2026-07-12

Updated: 2026-10-30

Comments: 25 pages, 11 figures, 11 tables. v2: substantially revised and retitled (v1: "LayerNorm as Implicit Gain Control in Looped Transformers"). Code available at https://github.com/clojure-finance/mythjure/tree/paper-v2

Code: https://github.com/clojure-finance/mythjure

License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/

Terminology

Sources

Related papers