Variance-Reduced Stochastic Hessian-Driven Nesterov Acceleration with Adam-Style Preconditioning
math.OC, cs.LG, cs.NA, math.NA
Submitted: 2026-11-08
Updated: 2026-11-08
Terminology
Sources
- First order optimization methods based on Hessian-driven Nesterov accelerated gradient flow
- Optimal Adaptive and Accelerated Stochastic Gradient Descent
- Adam-HNAG: A Convergent Reformulation of Adam with Accelerated Rate
- Adam-SHANG: A Convergent Adam-Type Method for Stochastic Smooth Convex Optimization
Related papers
- An Accelerated Proximal Gradient Method for Bures-Wasserstein Space
- FOMTools: Development and AI-Assisted Code Generation for First-Order Methods
- Lions and Muons: Optimization via Stochastic Frank-Wolfe under Heavy-Tailed Noise
- Dynamic Service Recommendation with Congestion-Dependent Joining: Near-Optimal and Constant-Factor Approximation Algorithms
- Integrating Learning and Optimization for Open Transport Capacity Pooling under Disruption
- Zeroth-Order Gradient Estimators under Decision-Dependent Noise