Adaptive dynamic programming using Lyapunov function constraints
The work proposes a stabilizing adaptive dynamic programming (ADP) method for solving infinite-horizon optimal control problems. It achieves this by simultaneously optimizing a critic function and ensuring closed-loop stability through the explicit use of a Lyapunov function. The analysis proves that the actor and critic parameters converge to specific neighborhoods around their respective optimal solutions.