Phases of Muon: When Muon Eclipses SignSGD

arXiv:2605.09552 · math.OC, cs.LG, stat.ML · Submitted 2026-05-10 · Read on arXiv

math.OC, cs.LG, stat.ML

Submitted: 2026-05-10

Updated: 2026-10-27

Terminology

• Adam — 2× in this paper · explained in 3 episodes
• Preconditioning — 2× in this paper · explained in 2 episodes

Related papers

• Lions and Muons: Optimization via Stochastic Frank-Wolfe under Heavy-Tailed Noise
• Adam-HNAG: A Convergent Reformulation of Adam with Accelerated Rate
• Incremental Learning in Mirror Flows
• Beyond Aggregate Drift: Optimal Client-Specific Windows in Federated Learning
• Lower Bounds for Randomized Linear-Oracle Optimization over Strongly Convex Sets
• Second-Order Optimization with Asynchronous Curvature