Measuring Affinity between Attention-Head Weight Subspaces via the Projection Kernel

arXiv:2601.10266 · cs.CL · Submitted 2026-01-15 · Read on arXiv

cs.CL

Submitted: 2026-01-15

Updated: 2026-11-02

Code: https://github.com/ymgw55/proj-kernel-attn-subspace

Project page: https://transformerlensorg.github.io/TransformerLens/generated/demos/Main_Demo.html

Terminology

Sources

Related papers