LongTails: Automated Research in Optimization
math.OC
Submitted: 2026-11-10
Updated: 2026-11-10
Code: https://github.com/k3nfalt/longtails
Project page: https://k3nfalt.github.io/longtails
Terminology
Sources
- The exact worst-case convergence rate of the gradient method with fixed step lengths for L-smooth functions
- Balancing Gradient and Hessian Queries in Non-Convex Optimization
- Revisiting Inexact Fixed-Point Iterations for Min-Max Problems: Stochasticity and Structured Nonconvexity
- Towards Weaker Variance Assumptions for Stochastic Optimization
- Even Faster Accelerated Coordinate Descent Using Non-Uniform Sampling
- Improved SVRG for Non-Strongly-Convex or Sum-of-Non-Convex Objectives
- Second-Order Information in Non-Convex Stochastic Optimization: Power and Limitations
- Sharp High-Probability Rates for Nonlinear SGD under Heavy-Tailed Noise via Symmetrization
- Fast Last-Iterate Convergence of SGD in the Smooth Interpolation Regime
- Highly-Smooth Zero-th Order Online Optimization Vianney Perchet
- Nesterov Finds GRAAL: Optimal and Adaptive Gradient Method for Convex Optimization
- Convex Optimization: Algorithms and Complexity
- Accelerated Stochastic Min-Max Optimization Based on Bias-corrected Momentum
- Accelerated Algorithms for Constrained Nonconvex-Nonconcave Min-Max Optimization and Comonotone Inclusion
- Lower Bounds for Finding Stationary Points I
- RanSOM: Second-Order Momentum with Randomized Scaling for Constrained and Unconstrained Optimization
- Faster Newton Methods for Convex and Nonconvex Optimization in Gradient Complexity
- Second-Order Min-Max Optimization with Lazy Hessians
- Near-Optimal Algorithms for Making the Gradient Small in Stochastic Minimax Optimization
- Generalized-Smooth Nonconvex Optimization is As Efficient As Smooth Nonconvex Optimization
Related papers
- An Accelerated Proximal Gradient Method for Bures-Wasserstein Space
- FOMTools: Development and AI-Assisted Code Generation for First-Order Methods
- Lions and Muons: Optimization via Stochastic Frank-Wolfe under Heavy-Tailed Noise
- Dynamic Service Recommendation with Congestion-Dependent Joining: Near-Optimal and Constant-Factor Approximation Algorithms
- Integrating Learning and Optimization for Open Transport Capacity Pooling under Disruption
- Zeroth-Order Gradient Estimators under Decision-Dependent Noise