A global stochastic maximum principle for forward-backward stochastic control systems with quadratic convex generator and unbounded terminal condition

summary

The gist

A global stochastic maximum principle for forward-backward stochastic control systems with quadratic convex generator and unbounded terminal condition is obtained by introducing a new probability…

In short

The paper develops a global stochastic maximum principle for forward-backward stochastic control systems that have quadratic convex generators and unbounded terminal conditions, even when the control domain is not necessarily convex. The authors introduce a new probability measure to handle issues with BMO martingale properties under these unbounded conditions, enabling well-posedness and providing estimates for the solutions.

Key concepts

Forward-Backward Stochastic Control Systems
These are mathematical models involving two coupled processes: an SDE (Stochastic Differential Equation) for the state process X(t) and a BSDE (Backward Stochastic Differential Equation) for the cost functional Y(t). The goal is to find an optimal control strategy u* that minimizes the total cost J(u).
Quadratic Convex Generator
This describes the structure of the system's dynamics, where the generator related to Y(t) has a quadratic term. 'Convex' implies certain desirable mathematical properties for analysis, which is crucial for establishing the existence and uniqueness of solutions in this control problem.
New Probability Measure (Q*)
This is a specially constructed measure used to analyze the well-posedness of linear BSDEs that arise from the adjoint and variational equations. It is introduced because standard methods fail when terminal conditions are unbounded, allowing the authors to simplify the analysis by eliminating problematic terms.
Stochastic Maximum Principle
This is a fundamental result in optimal control theory. It provides necessary conditions for finding an optimal control u*. The paper establishes a global version of this principle, meaning it holds for all possible controls within the allowed set, under the specific system conditions studied.

Terminology used across episodes

This episode discusses

The paper

A global stochastic maximum principle for forward-backward stochastic control systems with quadratic convex generator and unbounded terminal condition · Read on arXiv

Ying Hu, Feng Li, Jiaqiang Wen

University of Rennes · Southern University of Science and Technology

Transcript

Introduction to the show: ident: Mathematics. The day in mathematics: new theorems, new proofs, and what they open.

Ada: We're looking at the paper: "A global stochastic maximum principle for forward-backward stochastic control systems with quadratic convex generator and unbounded terminal condition".

Emmy: Here's the gist of the paper. A global stochastic maximum principle for forward-backward stochastic control systems with quadratic convex generator and unbounded terminal condition is obtained by introducing a new probability measure to handle the lack of BMO martingale properties under unbounded terminal conditions Problem Formulation and Context The paper studies a stochastic optimal control problem for forward-backward stochastic control systems with quadratic convex generator and unbounded terminal condition where the control domain is not necessarily convex The system involves an SDE for the state process X(t) and a BSDE for Y(t) The problem (O) seeks a control u∗(·) that minimizes the cost functional J(u(·)) = Y(0) Existing literature has established results for bounded terminal values, but this paper addresses the case with unbounded terminal conditions and a non-convex control domain Methodological Innovations The authors introduce a new probability measure Q∗ to analyze the well-posedness of linear BSDEs arising from the adjoint and variational equations This measure is defined by dQ∗dP = E

Z · 0 q∗(s)⊤dW(s): Under this measure, Girsanov’s transformation eliminates terms involving fz from the generators of the linear BSDEs, enabling well-posedness and estimates A new approach is provided for estimating (Yˆ ε,Zˆε) under this measure Key Analytical Results The paper establishes several key analytical results under the new measure Q∗ A stochastic maximum principle is obtained for forward-backward stochastic control systems with quadratic convex generator and unbounded terminal condition.

Ada: The Hamiltonian function H is defined in terms of P1, Q1, and P2 The theorem states that ∆H(t, u) ⩾ 0 for all u ∈ U a.e., a.s.

Emmy: The estimate for (Yˆ ε,Zˆε) is shown to be O(ε2) This is achieved by combining estimates derived from different probability measures and Taylor expansions The estimate for (Yˆ ε,Zˆε) is shown to be O(ε2) This result is derived from combining the estimates for Yˆ ε, Xˆ ε, and Zˆε under the measure Q∗ Adjoint Equations and Variational Analysis The paper presents the first-order and second-order adjoint equations (5.1) and (5.2) derived using Itô's formula and Taylor expansions The well-posedness of these adjoint equations is established under the new measure Q∗ The variational equation (5.4) for Yˆ(t) is given in terms of the adjoint variables and other terms The estimate for (Yˆ ε,Zˆε) is derived by analyzing the terms in the variational equation Final Estimate and Maximum Principle The final result shows that Yˆε 2(t) = Hε 2(T) − Z T t n˜f2εy(s)Yˆ ε 2(s) + J1(s) o ds + Z T t Zˆε 1(s)dWq∗(s), where J1 is defined in terms of various components The estimate for Yˆε 2(t) is bounded by a term involving Kε2 This leads to the conclusion that E

sup t∈[0,T: Yˆ ε 2(t)2] = O(ε2) The general stochastic maximum principle is stated in Theorem 8.1 which asserts that ∆H(t, u) ⩾ 0 for all u ∈ U a.e., a.s.

Ada: References

1: P Barrieu and N El Karoui, Monotone stability of quadratic semimartingales with applications to unbounded general quadratic BSDEs, Ann Probab., 41 (2013), pp.

Paper summary: Ada: So we're looking at this paper by Hu and Li about a global stochastic maximum principle for forward-backward stochastic control systems with quadratic convex generator and unbounded terminal condition. What they're tackling is a problem where the control domain isn't necessarily convex, which is a big deal in control theory.

Emmy: Exactly, it’s about finding an optimal strategy when you can’t assume the setup is nicely shaped. The paper claims they get a global stochastic maximum principle under these conditions using a new probability measure.

Kolya: Before we get into the technical bits, I want to ask what this means for us practically. If we can find this principle, what does that actually help us figure out when designing these systems?

Ada: It means they've addressed a gap in the literature where previous methods didn't apply because of those unbounded terminal conditions. They introduce a new measure specifically to handle that lack of BMO martingale properties under these conditions.

Emmy: That new measure is defined by dQ star dP equals EZ dot zero q star s top dW s. It lets them analyze the well-posedness of the linear backward stochastic differential equations that pop up in both the adjoint and variational equations.

Kolya: Okay, so they're replacing a standard tool because it doesn't work when things get unbounded. What’s the main result they use this measure to establish?

Ada: The main thing is that under this new measure Q star, Girsanov’s transformation eliminates those pesky terms involving f z from the generators of the linear backward stochastic differential equations. That makes them well-posed and allows them to get estimates.

Emmy: And they use this to prove a new approach for estimating both Y hat epsilon and Z hat epsilon under this measure, which is crucial for their subsequent analysis of the adjoint equations.

Kolya: So we’re hearing that the core difficulty was proving that the BSDEs were well-behaved enough to start with. What are the actual estimates they manage to get once they have that new measure in place?

Ada: They establish a stochastic maximum principle where, for example, the Hamiltonian function H has a property called delta H t u greater than or equal to zero for all control u almost surely. That’s the theorem of Theorem eight point one <ref:2609.21451#pg2>.

Emmy: And they also get an estimate for Y hat epsilon and Z hat epsilon that is O epsilon squared by combining results from different probability measures and using Taylor expansions.

Kolya: O epsilon squared sounds good, but what does that actually tell us about the stability or error of the solution in the control problem? Is it a tight bound?

Paper summary: Ada: It implies that once you get those estimates for Y hat epsilon and Z hat epsilon under this new measure, you can see that they are bounded by a term involving K epsilon squared. This ultimately leads to the conclusion that the expected supremum of Y hat epsilon squared over time is O epsilon squared.

Emmy: That means the error in the solution scales quadratically with some small parameter, which is a pretty strong statement about convergence. It shows that their approach works when things are unbounded, provided you use this new measure Q star.

Kolya: So if we translate that for someone who isn't deep in control theory, what’s the big picture takeaway here? What does this paper actually change for the field of stochastic control?

Ada: It fills a significant gap because previous results relied on the BMO martingale property, which just doesn't hold when you have unbounded terminal conditions. This paper provides a new way to proceed without that assumption.

Emmy: The implication is that we can now apply maximum principle techniques to forward-backward systems even when the control domain isn't smooth or convex, as long as we introduce this specialized probability measure.

Kolya: So, what are the limitations they admit? What’s the caveat on this new setup?

Ada: They note that they have to rely on certain assumptions for their work to hold under their current framework. For instance, in example one four of their analysis, if the stochastic process u is unbounded and defined by something like W t, then they cannot guarantee that a specific term involving e epsilon X hat T squared remains integrable.

Emmy: So even with this new measure and the O epsilon squared estimate for Y hat epsilon squared, they still hit a wall when the control itself becomes unbounded in a way that violates integrability requirements.

Kolya: That's fair. So, if we look at this paper by Hu and Li about forward-backward stochastic control systems with quadratic convex generator and unbounded terminal condition, what does it really add to the literature on optimal control?

Ada: It adds a global stochastic maximum principle for this specific class of systems where the control domain isn't necessarily convex. That’s a major addition because we’ve seen work on related problems, like those with bounded terminal values, but not this exact setup.

Emmy: The paper shows that by introducing the right mathematical tools—specifically that new probability measure Q star—we can overcome the hurdle posed by unbounded terminal conditions and non-convex constraints in these forward-backward systems.

Kolya: It’s about showing how to find a global optimum even when the standard machinery breaks down due to those boundary conditions. The main thing is that they've provided a path forward for solving this class of control problems.

Conclusion: Ada: So, we’re wrapping up our look at this paper about forward-backward stochastic control systems. The authors are tackling those tricky unbounded terminal conditions and non-convex control domains with a global maximum principle.

Emmy: It’s a dense piece of math, but the core idea is that they found a way to get an optimal strategy even when the setup isn't nice or bounded. They introduced this new probability measure Q star to handle the technical problems that pop up with those unbounded conditions.

Kolya: What does this really mean for us? It means we can finally apply these powerful maximum principle tools to control problems that used to be off-limits because of the growth of the terminal condition.

Ada: Exactly, it fills a real gap in the literature where previous results just didn't apply anymore because of those unbounded conditions. The authors show that with this new approach, we can establish a global maximum principle for these complex systems.

Emmy: From an algebraic standpoint, they managed to build the whole argument around this new measure Q star so that the linear backward stochastic differential equations become well-posed and solvable in a controlled way.

Kolya: And the results they get, like that big O of n squared estimate for Y hat epsilon squared, shows how stable these solutions are when you get those estimates under this measure. It gives us a concrete idea of the error scaling.

Ada: So, to sum it up, this paper provides a robust method for finding an optimal control in forward-backward systems with quadratic generators and unbounded terminal conditions, even when the control domain isn't convex.

Emmy: It’s about proving that structure—the global maximum principle—still holds true under these challenging mathematical circumstances.

Kolya: This opens the door to solving a whole class of problems we previously couldn't touch with existing literature. What we look at next is exactly how they prove those key estimates, which is where the real heavy lifting happens.

More episodes

← Home