Generalized Forcing Method: Generation of Diverse Data for Training Linear Transport PDE Closure Models

arXiv:2606.05141 · physics.flu-dyn · Submitted 2026-06-03 · Read on arXiv

Listen

Radio episode about this paper

Transcript

Introduction to the show: ident: Physics. The day in general physics: instruments, methods and results across the field.

Kai: We're looking at the paper: "Generalized Forcing Method".

Mira: Here's the gist of the paper. Data-driven closure modeling for transport partial differential equations requires training data that are accurate, affordable, diverse, and directly tailored to the target closure fields The Generalized Forcing Method (GFM) is a data-generation framework for training linear transport closure models This framework generates such data by running simulations with a zero initial condition and an extra body force that is constructed compatibly with the reduced dynamics The results show that eGFM can identify accurate and stable reduced models when the reduced variables and model form are consistent with the underlying closure relation Framework Development The GFM framework is designed to address the "TAAD" criteria for data generation, which include being tailored, accurate, affordable, and diverse The method generates data by introducing a forcing term that actively excites the resolved variables This ensures that the resulting dynamics span the model input space to form a well-conditioned regression problem Two strategies are proposed for constructing forcings: implicit GFM (iGFM), which enforces a prescribed trajectory of the resolved variables, and explicit GFM (eGFM), which constructs a basis of admissible forcings Model Identification Strategy The objective is to identify an equivalent reduced model from data by constructing a physics-based, explicit, and interpretable closure The modeling task is formulated as a regularized linear regression problem using the proposed reduced model form A combined fitting strategy is adopted where the quantity to be modeled is defined as ∂f/∂t − Ms, where Ms is the forcing contribution that does not need to be modeled since it is absent in the original system This avoids cumbersome algebraic manipulations and ensures that both traditional and combined approaches recover the same coefficients under ordinary least squares Model Selection Criteria The selection of resolved variables is guided by a spectral hierarchy established from analytical solutions, which motivates the choice of the first n resolved modes as the primary basis Two types of reduced variables are considered: spectral-based variables, defined using Fourier modes, and velocity-based variables, defined from velocity moments For parallel flows, spectral-based models are generally preferred due to symmetry in the velocity field in y However, for inhomogeneous flows or random flows with finite temporal correlation, the choice of variables strongly affects model performance Performance and Limitations The results demonstrate that eGFM-based models can recover reduced models whose accuracy is comparable to analytical models and those fitted directly from the test data In inhomogeneous flows, spectral-based variables show better stability and accuracy than direct-fit approaches for certain ranges of n For random flows with finite temporal correlation, the spectral-based and velocity-based variables are not capable of representing the memory effects in a Markovian model This indicates that further studies on selecting appropriate reduced variables or model forms are necessary for this type of flow Turbulence Application The framework was extended to passive-scalar transport in homogeneous isotropic turbulence (HIT) where the two-equation model captures most of the long-time dispersion behavior The three-equation model further improves the transient prediction Models fitted using lower-resolution turbulence data are predictive when evaluated against the higher-resolution test data This demonstrates the applicability of eGFM to turbulent scalar transport The paper concludes that GFM can be used to train neural-network-based closure models by extending the forcing design strategy Future Directions Future work should focus on extensions to non-dissipative or coupled systems where stability may need to be imposed explicitly during model fitting A problem- and target-dependent procedure for basis selection is needed, particularly for cases with strong nonlocality such as random flows Statistical tools for sampling, data weighting, and uncertainty quantification should be developed in combination with GFM for reliability-based modeling Extending GFM to nonlinear systems is substantially more challenging and will likely require a problem-dependent forcing design Acknowledgments

Paper summary: Kai: So, to recap, this paper from arXiv titled "Generalized Forcing Method: Generation of Diverse Data for Training Linear Transport PDE Closure Models" is about creating a data-driven way to train models for transport equations. The authors argue that you need training data that is accurate, affordable, diverse, and tailored precisely to the closure fields you are trying to model.

Mira: Their main thesis is the Generalized Forcing Method or GFM, which they introduce as a framework specifically designed for generating this required data. They do this by running simulations with a zero initial condition and adding an extra body force that is constructed in a way that fits the reduced dynamics you are interested in.

Lev: The paper claims this leads to two main approaches: implicit GFM, which dictates a specific path for the resolved variables, and explicit GFM, which constructs a set of allowed forcings. This gives researchers more control over how they generate their training data.

Kai: The crucial claim they make is that when you use the explicit version of this method, eGFM specifically can find reduced models that are both accurate and stable as long as the variables you pick and the model form are consistent with the underlying closure relation.

Mira: It matters because it suggests a specific way to set up your modeling problem—it's not just about finding any fit; it's about finding a fit where the structure of your reduced variables aligns with physics.

Lev: This method is particularly useful because traditional ways of getting diverse data, like changing geometry or boundary conditions, can be too expensive for complex systems. GFM offers a more affordable way to explore the necessary state space.

Kai: They test this across parallel flows, inhomogeneous flows, random flows with finite temporal correlation, and even passive-scalar transport in homogeneous isotropic turbulence. This shows the method is quite broad in what it can handle physically.

Mira: The results show that for inhomogeneous and random flows with finite temporal correlation, spectral-based variables proved more stable and accurate than direct fitting to test data for specific numbers of resolved modes.

Lev: I think this means if you're dealing with complex, non-uniform turbulence or random fields, sticking to a spectral basis might be the safer bet for stability when training these models.

Conclusion: Kai: So, wrapping up this discussion on "Generalized Forcing Method: Generation of Diverse Data for Training Linear Transport PDE Closure Models," the authors are essentially saying that GFM provides a systematic way to generate high-quality training data for transport partial differential equations.

Mira: They developed this framework to tackle the challenge of getting data that is accurate, affordable, and diverse enough to train these models effectively. The framework allows you to generate simulations by carefully designing the added body force based on the reduced dynamics you want to model.

Lev: The implications are that researchers can move away from relying solely on expensive setup variations and start using a method like eGFM to build data sets that are actually tailored for the final closure relation they aim to use.

Kai: It suggests a more structured approach to closing these equations, where the choice of variables and model form plays a much bigger role in the success of the model identification process.

Mira: Exactly. It's not just about getting a number close to something; it’s about ensuring the structure of your chosen variables actually reflects how things move in that specific physical system.

Lev: The limitation they pointed out is that for flows with finite temporal correlation, spectral and velocity based variables might not be enough to capture all the memory effects in a Markovian model, so you still have work to do there.

Kai: So while GFM is a powerful tool for generating data for these transport models, we still need careful decisions about our variable selection when dealing with those tricky memory effects.

Stanford University

physics.flu-dyn

Submitted: 2026-06-03

Updated: 2026-09-05

Journal ref: Phys. Rev. Fluids 11, 114901 (2026)

DOI: 10.1103/52jk-xb5y

License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/

Importance score: 89/100

The gist: Data-driven closure modeling for transport partial differential equations requires training data that are accurate, affordable, diverse…

Key concepts

Generalized Forcing Method (GFM)
A data generation framework used to train linear transport PDE closure models. It works by running simulations with a zero initial condition and an extra body force constructed to excite resolved variables, ensuring the resulting dynamics cover the model's input space for good regression.
Implicit GFM (iGFM)
One strategy within GFM where the forcing term is used to enforce a predefined trajectory for the resolved variables. This method helps ensure that the generated data spans a specific path in the model's input space, aiding in model identification.
Explicit GFM (eGFM)
A second strategy in GFM where a basis of admissible forcing terms is constructed. This approach generates diverse data by systematically building up a set of forcings that are relevant to the system dynamics, leading to more robust training data.
Reduced Variables
Variables used in the model that represent the most important physical information, derived from the original complex system. The paper considers spectral-based variables (using Fourier modes) and velocity-based variables (from velocity moments) as potential choices for these reduced representations.

Terminology

Summary

Data-driven closure modeling for transport partial differential equations requires training data that are accurate, affordable, diverse, and directly tailored to the target closure fields The Generalized Forcing Method (GFM) is a data-generation framework for training linear transport closure models This framework generates such data by running simulations with a zero initial condition and an extra body force that is constructed compatibly with the reduced dynamics The results show that eGFM can identify accurate and stable reduced models when the reduced variables and model form are consistent with the underlying closure relation

Framework Development

The GFM framework is designed to address the TAAD criteria for data generation, which include being tailored, accurate, affordable, and diverse The method generates data by introducing a forcing term that actively excites the resolved variables This ensures that the resulting dynamics span the model input space to form a well-conditioned regression problem Two strategies are proposed for constructing forcings: implicit GFM (iGFM), which enforces a prescribed trajectory of the resolved variables, and explicit GFM (eGFM), which constructs a basis of admissible forcings

Model Identification Strategy

The objective is to identify an equivalent reduced model from data by constructing a physics-based, explicit, and interpretable closure The modeling task is formulated as a regularized linear regression problem using the proposed reduced model form A combined fitting strategy is adopted where the quantity to be modeled is defined as ∂f/∂t − Ms, where Ms is the forcing contribution that does not need to be modeled since it is absent in the original system This avoids cumbersome algebraic manipulations and ensures that both traditional and combined approaches recover the same coefficients under ordinary least squares

Model Selection Criteria

The selection of resolved variables is guided by a spectral hierarchy established from analytical solutions, which motivates the choice of the first n resolved modes as the primary basis Two types of reduced variables are considered: spectral-based variables, defined using Fourier modes, and velocity-based variables, defined from velocity moments For parallel flows, spectral-based models are generally preferred due to symmetry in the velocity field in y However, for inhomogeneous flows or random flows with finite temporal correlation, the choice of variables strongly affects model performance

Performance and Limitations

The results demonstrate that eGFM-based models can recover reduced models whose accuracy is comparable to analytical models and those fitted directly from the test data In inhomogeneous flows, spectral-based variables show better stability and accuracy than direct-fit approaches for certain ranges of n For random flows with finite temporal correlation, the spectral-based and velocity-based variables are not capable of representing the memory effects in a Markovian model This indicates that further studies on selecting appropriate reduced variables or model forms are necessary for this type of flow

Turbulence Application

The framework was extended to passive-scalar transport in homogeneous isotropic turbulence (HIT) where the two-equation model captures most of the long-time dispersion behavior The three-equation model further improves the transient prediction Models fitted using lower-resolution turbulence data are predictive when evaluated against the higher-resolution test data This demonstrates the applicability of eGFM to turbulent scalar transport The paper concludes that GFM can be used to train neural-network-based closure models by extending the forcing design strategy

Future Directions

Future work should focus on extensions to non-dissipative or coupled systems where stability may need to be imposed explicitly during model fitting A problem- and target-dependent procedure for basis selection is needed, particularly for cases with strong nonlocality such as random flows Statistical tools for sampling, data weighting, and uncertainty quantification should be developed in combination with GFM for reliability-based modeling Extending GFM to nonlinear systems is substantially more challenging and will likely require a problem-dependent forcing design

Acknowledgments

Green — the paper says it, and the page is printed. Red — no passage carries it, so treat that sentence as unverified. The same check runs on your own text: check a summary against its source, $5.

Improvements for AI systems

  1. Enhanced data generation for linear transport closure models by implementing an explicit Generalized Forcing Method (eGFM). This allows for constructing a basis of admissible forcings, which is crucial for training data that is tailored and diverse to probe the target closure fields accurately.

  2. Development of a combined fitting strategy where the quantity to be modeled is formulated as partial time derivative minus forcing contribution: ∂f/∂t − Ms. This simplifies the regression process by avoiding cumbersome term-by-term modeling of forcing terms, which is equivalent under ordinary least squares but avoids post-processing steps.

  3. Implementation of a constrained regularized least-squares problem that incorporates a Tikhonov regularization term with parameter lambda to ensure smoothness of coefficient functions in space for inhomogeneous flows. This addresses the ill-conditioning and overfitting issues associated with pointwise fitting of coefficients derived from data.

  4. Creation of two distinct reduced model families, spectral-based and velocity-based variables, allowing the AI system to compare performance across different physical choices for resolved variables in parallel flow problems. This enables selection of the most appropriate variable choice based on specific flow characteristics and model requirements.

  5. Capability to generate predictive models for passive scalar transport in homogeneous isotropic turbulence using a three-equation reduced model that captures both long-time dispersion behavior and transient prediction accuracy. This demonstrates the framework's applicability to complex, statistically stationary turbulent environments.

Related papers