The Smallest Singular Directions of the Unembedding Matter Disproportionately for Next-Token Prediction

arXiv:2605.17084 · cs.LG, cs.CL · Submitted 2026-05-16 · Read on arXiv

cs.LG, cs.CL

Submitted: 2026-05-16

Updated: 2026-11-03

Terminology

Sources

Related papers