Sharp Critical Minimax Laws and No-Learning Thresholds in Continuous-Time Adaptive Control
math.OC, cs.LG
Submitted: 2026-09-27
Updated: 2026-09-27
License: http://creativecommons.org/licenses/by/4.0/
The gist: We study episodic continuous-time control with an unknown vector control gain, scalar state, quadratic action cost, and smooth convex terminal cost.
Terminology
Abstract
We study episodic continuous-time control with an unknown vector control gain, scalar state, quadratic action cost, and smooth convex terminal cost. In the scalar Gaussian experiment, let Δ(H) denote the minimax improvement over zero control and set δ= sqrt2H 2-1. We prove the critical law Δ(H) δ 4 sqrt (1/δ) (δ 0), with a matching lower and upper bound. The lower bound follows from a uniform deficit--energy inequality valid for fully adaptive controls with unbounded amplitudes, while a moving soft-threshold feedback attains the rate. For local parameters θ=N-1/4h, h H, we show that the normalized minimax regret over N episodes is within O(N-1/2) of a fixed-horizon Gaussian sequential control problem, without an additional dimension factor. The terminal task enters the limit only through c g= Var(g(Z)). The Gaussian problem exhibits an exact no-learning phase transition: C d T(H)=TH 2/2 H 4T d 2/2, yielding the asymptotic task boundary c gH 4=d 2/2.
Sources
- Exploration-exploitation trade-off for continuous-time episodic reinforcement learning with linear-convex models
- A sequential estimation problem with control and discretionary stopping
- On the Fundamental Limits of Adaptive Sensing
- How to sample and when to stop sampling: The generalized Wald problem and minimax policies
- Continuous time asymptotic representations for adaptive experiments
- Limiting laws associated with Brownian motion perturbated by normalized exponential weights I
- On occupation times of one-dimensional diffusions
- Optimal adaptive control with separable drift uncertainty
Related papers
- Lions and Muons: Optimization via Stochastic Frank-Wolfe under Heavy-Tailed Noise
- Adam-HNAG: A Convergent Reformulation of Adam with Accelerated Rate
- Incremental Learning in Mirror Flows
- Second-Order Optimization with Asynchronous Curvature
- Online Control via Counterfactual Tracking
- Asynchronous Replanning in Two Population Linear Quadratic Mean Field Games: Information Requirements and Stability