A Geometric Invariant of Attention Predicts Head Specialization from Weights Alone

arXiv:2611.12206 · cs.LG, cs.CL · Submitted 2026-11-09 · Read on arXiv

cs.LG, cs.CL

Submitted: 2026-11-09

Updated: 2026-11-09

Code: https://github.com/MPedraBento/rho-invariant

Terminology

Sources

Related papers