Weight-norm Criticality: A Mechanism for Loss Spikes Induced by the Normalization and Weight Decay

arXiv:2607.21005 · cs.LG, cs.NE · Submitted 2026-07-23 · Read on arXiv

cs.LG, cs.NE

Submitted: 2026-07-23

Updated: 2026-11-11

Terminology

Sources

Related papers