Almost Sure Convergence of Stochastic Approximation: An Interplay of Noise and Step Size

arXiv:2602.10580 · math.OC, math.PR · Submitted 2026-02-11 · Read on arXiv

math.OC, math.PR

Submitted: 2026-02-11

Updated: 2026-10-24

Terminology

• Fixed Point — 1× in this paper · explained in 2 episodes
• Heavy-Tailed Noise — 1× in this paper · explained in 3 episodes
• Lyapunov function — 1× in this paper · explained in 2 episodes

Related papers

• Lions and Muons: Optimization via Stochastic Frank-Wolfe under Heavy-Tailed Noise
• Adam-HNAG: A Convergent Reformulation of Adam with Accelerated Rate
• Incremental Learning in Mirror Flows
• Beyond Aggregate Drift: Optimal Client-Specific Windows in Federated Learning
• Lower Bounds for Randomized Linear-Oracle Optimization over Strongly Convex Sets
• Second-Order Optimization with Asynchronous Curvature