Dimension-Optimal Dynamic Regret in Exp-Concave Online Learning
cs.LG, math.OC
Submitted: 2026-10-14
Updated: 2026-10-14
License: http://creativecommons.org/licenses/by/4.0/
The gist: Tracking changing comparators is a central problem in online learning.
Terminology
Abstract
Tracking changing comparators is a central problem in online learning. For exp-concave losses, previous work established the T 1/3P T 2/3 dependence on the horizon T and Euclidean path length P T for fixed dimension, while the optimal cost of dimension remained unresolved. We resolve this question by establishing a sharp d 1/3 curved dimension factor, improving the d 2/3 factor of recent switching and interval reductions [1, 2]. To achieve this improvement, we develop a proper, full-information learner on compact convex subsets of R d that adapts to the unknown path length and, under fixed dimension-independent diameter, gradient, and curvature parameters, guarantees Reg T(u 1:T) (d+ d 1/3T 1/3P T 2/3, sqrt TP T,T). A matching lower bound on a diameter-one Euclidean ball establishes the minimax frontier up to logarithmic factors when T d squared, including the transition from the curved rate to larger path budgets. The lower bound already holds for losses that depend on only one coordinate per round, isolating an unavoidable cost of learning across directions. Our upper bound follows from square-root Gaussian KL control of comparator movement and a cancellation argument that pays for history restarts. The curved learner maintains O(squared T) Gaussian states, uses one gradient per round, and runs in time near-linear in T under a Mahalanobis-projection oracle.
Related papers
- Polynomial-Augmented Neural Networks (PANNs) with Weak Orthogonality Constraints for Enhanced Function and PDE Approximation
- AIRL-S: Unifying Reinforcement Learning and Search-Based Test-Time Scaling via Adversarial Inverse Reinforcement Learning
- Transformers as Bayesian In-Context Experimenters: Smoothness-Adaptive Efficient ATE Estimation
- Convergence issues in Relational Concept Analysis based on AOC-posets
- Beliefs Beyond Posteriors: The Predictive Cost of ELBO Binding
- Understanding Diffusion Models via Ratio-Based Function Approximation with SignReLU Networks