Watch Your Step: Adam's Margin Maximization Bias Depends on the Learning Rate Schedule

arXiv:2611.01929 · cs.LG, stat.ML · Submitted 2026-11-01 · Read on arXiv

cs.LG, stat.ML

Submitted: 2026-11-01

Updated: 2026-11-13

Code: https://github.com/EitanGronich/adam-implicit-bias-lr-schedule

Terminology

Sources

Related papers