The Effect of Quadrature on the Convergence of Policy Iteration for Hamilton-Jacobi-Bellman Equations

arXiv:2606.24806 · math.NA, cs.NA · Submitted 2026-06-23 · Read on arXiv

math.NA, cs.NA

Submitted: 2026-06-23

Updated: 2026-06-23

Journal ref: Journal of Scientific Computing, volume 109, article number 79 (2026)

DOI: 10.1007/s10915-026-03480-9

Code: https://github.com/tomhall-git/hjb-policy-iteration-quadrature

License: http://creativecommons.org/licenses/by/4.0/

The gist: Modern finite element libraries allow users to express partial differential equations directly in variational form, with the added convenience of automatic quadrature selection.

Terminology

Abstract

Modern finite element libraries allow users to express partial differential equations directly in variational form, with the added convenience of automatic quadrature selection. In the context of Hamilton-Jacobi-Bellman (HJB) equations, automatic quadrature selection can result in nonmatching quadratures between different terms that may lead to loss of convergence of the policy iteration, which is otherwise expected from theory to converge superlinearly. The simple remedy of enforcing matching quadrature recovers the expected superlinear convergence.

Related papers