Stochastic Optimal Control with Measurable Coefficients and Applications
summary
The gist
Stochastic optimal control problems with merely measurable coefficients are not well understood <ref:2502.02352#pg2> In this manuscript…
In short
The paper tackles fully non-linear stochastic optimal control problems with measurable coefficients and local uniform elliptic diffusion, which are often poorly understood. It introduces L p-viscosity solutions to prove existence of a strong solution to the Hamilton-Jacobi-Bellman (HJB) equation. This allows for constructing optimal feedback controls and uniquely characterizes the value function.
Key concepts
- L p-viscosity solution
- This is a mathematical tool used to define solutions for complex partial differential equations (PDEs) that have measurable coefficients. It extends the traditional notion of viscosity solutions by using a larger class of test functions, which helps in proving the existence and uniqueness of solutions even when standard methods fail.
- Hamilton-Jacobi-Bellman (HJB) equation
- This is a fundamental PDE in optimal control that describes the value function. Solving it is key to finding the optimal strategy for minimizing a cost functional. The paper shows that L p-viscosity solutions can be used to find strong solutions, meaning they satisfy the equation pointwise almost everywhere.
- Verification Theorems
- These theorems provide necessary and sufficient conditions for determining if a given control policy is optimal. By using these theorems, the authors can construct the actual optimal feedback controls and verify that the value function found is indeed unique among all possible solutions.
- Strong Solution (W2,p loc)
- A strong solution means that the solution to the HJB equation satisfies it in a stronger sense—pointwise almost everywhere. The paper proves that an L p-viscosity solution with $p ext{ ≥ } n$ is actually a strong solution, which is crucial for applying verification theorems and proving uniqueness.
Terminology used across episodes
This episode discusses
- Stochastic Optimal Control with Measurable Coefficients and Applications · Paper Radio
- Stochastic optimal control problems with measurable coefficients and unbounded drift · Paper Radio
- Stochastic optimal control in Hilbert spaces: C 1,1 regularity of the value function and optimal synthesis via viscosity solutions
- Optimal control of SDEs with merely measurable drift: an HJB approach
The paper
Stochastic Optimal Control with Measurable Coefficients and Applications · Read on arXiv
FILIPPO DE FEO
Deutsche Forschungsgemeinschaft · INdAM · Gruppo Nazionale per l’ Analisi Matematica, la Probabilité e le loro Applicazioni · Italian Ministry of University and Research
Transcript
Introduction to the show: ident: Mathematics. The day in mathematics: new theorems, new proofs, and what they open.
Ada: I'm Ada.
Emmy: And I'm Emmy, here with Kolya.
Ada: We're looking at the paper: "Stochastic Optimal Control with Measurable Coefficients and Applications".
Emmy: Here's the gist of the paper. Stochastic optimal control problems with merely measurable coefficients are not well understood <ref:2502.02352#pg2> In this manuscript, we consider fully non-linear stochastic optimal control problems in infinite horizon with measurable coefficients and (local) uniformly elliptic diffusion <ref:2502.02352#pg2>.
Ada: Using the theory of Lp-viscosity solutions, we show existence of an Lp-viscosity solution v ∈ W2,p loc of the Hamilton-Jacobi-Bellman (HJB) equation, which, in turn, is also a strong solution (i.e.
Emmy: it satisfies the HJB equation pointwise a.e.) <ref:2502.02352#pg2>.
Ada: These results allow us to construct optimal feedback controls and to characterize the value function as the unique Lp-viscosity solution of the HJB equation <ref:2502.02352#pg2>.
Paper summary: Ada: So to recap, this paper tackles fully non-linear stochastic optimal control problems with infinite horizon where the coefficients are only measurable, not necessarily smooth. The core thesis is that using Lp-viscosity solutions, they prove existence of a solution v in W 2,p locally for the Hamilton-Jacobi-Bellman equation <ref:2502.02352#pg1>.
Emmy: And they push that further by showing this Lp-viscosity solution is also a strong solution, which means it satisfies the Hamilton-Jacobi-Bellman equation pointwise almost everywhere. They then use these solutions to prove verification theorems which tell us exactly when a control strategy is optimal.
Kolya: I wonder what the implications are for someone looking at advertising models, since they mention that as an application area? Does this theory help solve problems where the underlying dynamics or costs aren't perfectly smooth?
Ada: The paper applies these ideas to a stochastic optimal control problem in economics, specifically in the context of optimal advertising. They set up a controlled one-dimensional stochastic differential equation for stock of advertising goodwill, and they minimize an expected cost functional.
Emmy: The results allow them to characterize the value function V as the unique Lp-viscosity solution of the Hamilton-Jacobi-Bellman equation. This means even with those tricky measurable coefficients, there's a definitive way to find that optimal value function.
Conclusion: Ada: Looking at the title, Stochastic Optimal Control with Measurable Coefficients and Applications, it really highlights the scope—it’s about solving control problems where we don't assume nice things like continuity or Lipschitz conditions on our functions. The authors are showing that this framework works for these rougher coefficient settings.
Emmy: What this means in plain terms is that you don't need perfectly smooth functions to find an optimal strategy in a complex stochastic system, as long as the diffusion part is locally uniformly elliptic. They establish that the value function can be characterized uniquely by this Lp-viscosity solution framework.
Kolya: So, for someone just listening to this show, what's the real-world impact? It means we can apply these techniques to economic models where things aren't perfectly smooth—like advertising spending decisions—and get a solid answer on what the best strategy is.
Ada: Right. It’s about extending control theory into areas where standard smoothness assumptions fail, giving us tools to solve problems that were previously out of reach. This paper provides a way to construct those optimal feedback controls directly from this unique solution structure.
Emmy: So we have the existence, the uniqueness of the value function as an Lp-viscosity solution, and a method to find the optimal control policy through measurable selections. It's a comprehensive toolkit for non-smooth settings in stochastic control.
More episodes
- 2509.05860-Concentration Inequalities for Branching Random Walks
- 2509.19309-Small Prime Primitive Roots in Arithmetic Progressions
- 2509.21830-Noncollapsing for Curvature Flows with Inhomogeneous Speeds
- 2510.08346-Separability and Submetrizability in Locally Convex Spaces
- 2510.27290-Borel Combinatorics of Schreier Graphs of Z-actions
- 2511.13500-Sampling Density for Gabor Phase Retrieval
- 2511.19161-Linear dynamics of random products of weighted shifts
- 2511.21548-Metastability of diffusion processes in narrow tubes
- 2512.01536-Abelian approximations for bicrossed products
- 2601.02524-Lagrangian slice disks with symplectomorphic exteriors