PhiBE-Q-Learning: Bridging Off-Policy Reinforcement Learning and Continuous-Time Control

arXiv:2606.21925 · math.OC · Submitted 2026-06-20 · Read on arXiv

math.OC

Submitted: 2026-06-20

Updated: 2026-10-20

Terminology

• Reinforcement Learning — 2× in this paper · explained in 4 episodes
• Convergence Guarantees — 1× in this paper · explained in 3 episodes
• Q-learning — 1× in this paper · explained in 3 episodes

Related papers

• Lions and Muons: Optimization via Stochastic Frank-Wolfe under Heavy-Tailed Noise
• Adam-HNAG: A Convergent Reformulation of Adam with Accelerated Rate
• Incremental Learning in Mirror Flows
• Beyond Aggregate Drift: Optimal Client-Specific Windows in Federated Learning
• Lower Bounds for Randomized Linear-Oracle Optimization over Strongly Convex Sets
• Second-Order Optimization with Asynchronous Curvature