A physics-constrained neural solver for incompressible flows without labeled data
summary
The gist
Physics-informed neural networks (PINNs) have shown considerable promise for solving partial differential equations…
In short
This method uses a physics-informed neural network approach, specifically a pressure-Poisson-based objective function, to solve incompressible fluid flow equations without needing labeled data. It enforces physical constraints like the divergence-free condition and boundary conditions using an augmented Lagrangian method. The approach successfully simulates complex flows, including vortex shedding in cylinder flows up to high Reynolds numbers.
Key concepts
- PECANN
- Physics-and equality-constrained artificial neural network framework used to solve problems where physical laws must be strictly satisfied. It minimizes the residual of the pressure Poisson equation while treating momentum and continuity equations as constraints on the network's output.
- CA-ALM
- Conditionally adaptive augmented Lagrangian method, a technique used to transform constrained optimization problems into unconstrained ones. It uses Lagrange multipliers and penalty parameters to enforce physical constraints like divergence-free flow in a manageable way during training.
- Entropy Residual
- A specific residual calculated by comparing the predicted velocity field against a reference velocity vector. This residual is used to adaptively update an entropy viscosity, which helps stabilize the training process, especially for high Reynolds number flows.
- Meshless Flow Solver
- A solver where the fluid flow variables are entirely represented by neural networks trained on randomly distributed points in space, rather than a traditional grid. This allows for flexible representation of complex geometries and boundary conditions.
Terminology used across episodes
This episode discusses
- A physics-constrained neural solver for incompressible flows without labeled data · Paper Radio
- Physics-Constrained Deep Learning of Incompressible Cavity Flows
- SOAP: Improving and Stabilizing Shampoo using Adam
- Simulating Three-dimensional Turbulence with Physics-informed Neural Networks
The paper
A physics-constrained neural solver for incompressible flows without labeled data · Read on arXiv
Qifeng Hu, Inanc Senocak
Department of Mechanical Engineering and Materials Science, University of Pittsburgh
We present a physics-constrained neural solver for incompressible flow that requires neither labeled data nor supervised pretraining. The solver enforces incompressibility and boundary conditions (BCs) to strict tolerances. We attribute the limited Reynolds numbers of existing physics-informed approaches to insufficient enforcement of these constraints, on which conventional finite-difference and finite-volume solvers depend. We therefore formulate incompressible flow as a constrained optimization problem within the physics- and equality-constrained artificial neural network (PECANN) framework: the pressure Poisson residual is minimized subject to the momentum equations, continuity equation, and BCs imposed as equality constraints on the primitive variables, while a conditionally adaptive augmented Lagrangian method enforces each constraint. The pressure Poisson objective proves critical. Across all benchmarks, replacing it with the momentum residual fails to converge to accurate solutions under identical architecture and constraint enforcement, which we attribute to the global elliptic coupling of pressure and velocity that local momentum-residual minimization lacks. For advection-dominated flows, we introduce an adaptive vanishing entropy viscosity that stabilizes training while leaving the converged solution unchanged. The solver predicts lid-driven cavity flow up to Re = 7,500 with centerline velocity profiles matching benchmark data, and is further validated on flow over a backward-facing step at Re = 800, 3D unsteady Beltrami flow, and steady and unsteady flow past a circular cylinder under an inflow-outflow configuration, for which an ablation study identifies admissible outlet BCs for velocity and pressure. From a randomly initialized network and without external perturbations, the solver captures the spontaneous onset of periodic vortex shedding in unsteady cylinder flow.
Transcript
Introduction to the show: ident: Physics. The day in general physics: instruments, methods and results across the field.
Kai: We're looking at the paper: "A physics-constrained neural solver for incompressible flows without labeled data".
Paper summary: Kai: So, we're looking at this paper called "A physics-constrained neural solver for incompressible flows without labeled data". This research is tackling a problem where physics informed neural networks have struggled with incompressible flows, especially when things get really fast, like high Reynolds numbers.
Mira: Exactly. The core idea here is that existing methods need some kind of labeled data or reference solutions to work well, and this paper claims they've found a way to do it without that help.
Lev: It’s about overcoming the lack of a solid mechanism for enforcing the divergence-free constraint and boundary conditions with strict tolerances, which is what conventional solvers absolutely need for incompressible flow accuracy.
Kai: So, this method uses something called the physics and equality constrained artificial neural network framework, PECANN, paired up with a conditionally adaptive augmented Lagrangian method, CA-ALM.
Mira: That CA-ALM part is key because it recasts the problem into an unconstrained form by using Lagrange multipliers and penalty parameters to handle those constraints.
Lev: From where I look at real hardware, the overhead of these constraint enforcement mechanisms needs to be managed carefully when you try to run them on something that isn't perfectly structured.
Kai: The objective function they are minimizing is defined by minimizing the mean square residual of the pressure Poisson equation, but this minimization is subject to residuals from momentum equations in each direction, the divergence-free condition, and boundary conditions.
Mira: They set up a constrained optimization problem where they're trying to minimize that pressure Poisson residual while keeping those other equations satisfied with certain squared norms being zero over the entire domain.
Lev: If you look at how they set up the scaling factors for those PDE constraints, they have to make sure those are smaller than the scaling factors for the boundary and initial conditions so that everything locks in early.
Kai: To stabilize things, they propose two specific techniques: first, computing an entropy residual directly from the predicted velocity and pressure field by calculating (velocity minus a reference velocity) dotted with some vector F.
Mira: And then they use an exponential moving average of the squared entropy norm to update an adaptive vanishing entropy viscosity based on its unbiased root at each epoch.
Lev: That adaptive vanishing entropy viscosity is specifically for high Reynolds number cases, which sounds like it's a way to stabilize early training without messing up the final prediction fidelity.
Kai: On the benchmark results, they tested this method on several problems without any labeled data or supervised pretraining.
Mira: They showed that this approach captures the spontaneous onset of periodic vortex shedding in unsteady cylinder flow even when starting from a randomly initialized neural network.
Lev: And for the 2D lid-driven cavity flow benchmark, they found that the velocity-pressure formulation achieved good results up to Reynolds numbers of seven thousand five hundred.
Kai: So, the method seems robust across different tests, including three dee Beltrami flow and both steady and unsteady two-dimensional cylinder flows <ref:2511.18820#pg2>.
Mira: It's important to remember this is a meshless flow solver where all the flow variables are represented entirely by neural networks trained on randomly distributed collocation points.
Lev: That means the training cost for this method ends up being roughly two orders of magnitude higher than that of conventional solvers, which is a significant overhead for practical use.
Kai: So, what does this mean for us? It shows that even with all those constraint enforcement machinery, the baseline naïve formulation just doesn't work on its own.
Mira: The paper argues that this pressure-Poisson-based formulation is a new way to enforce the divergence-free condition that’s fundamental to solving these incompressible flow equations.
Lev: For someone building real hardware, it implies that you need this kind of physics constraint baked into your loss function if you want a neural network approach to actually work for fluid dynamics.
Kai: The authors say they are providing a robust foundation for future extensions toward things like complex moving boundaries and inverse problems in fluid flow.
Mira: It suggests that we might be able to get better results in these complex areas without relying on pre-existing data, which is a big deal.
Conclusion: Kai: So, this paper is about taking those physics informed neural networks, which are usually good for some stuff, and trying to make them actually work for incompressible flows without needing any pre-labeled data or reference solutions.
Mira: Right, it's titled "A physics-constrained neural solver for incompressible flows without labeled data." The authors are tackling the fundamental problem that these models struggle when things get really complex, like high Reynolds numbers.
Lev: They’re using a pressure Poisson-based objective function to force the divergence-free constraint and boundary conditions to be very tight tolerances. That sounds like a lot of work just to set up the math right.
Kai: They are using this physics and equality constrained artificial neural network framework, PECANN, combined with something called a conditionally adaptive augmented Lagrangian method, CA-ALM. It’s essentially minimizing the pressure Poisson equation while making sure all those momentum and continuity equations stay zero over the whole domain.
Mira: That means they're setting up an unconstrained problem by using Lagrange multipliers and penalty parameters to handle all those physical constraints simultaneously. It’s a clever way to structure the loss function.
Lev: From what I see, the scaling factors for those differential equation constraints have to be smaller than the ones for boundary conditions and initial conditions so that everything locks in early during training.
Kai: They also added some stabilization techniques, like computing an entropy residual directly from the predicted velocity and pressure field to keep things from blowing up. And they use an adaptive vanishing entropy viscosity specifically for high Reynolds number cases to stabilize early training without messing up the final prediction.
Mira: The results are interesting because they tested this on problems without any labeled data or supervised pretraining. They showed it can capture the spontaneous onset of periodic vortex shedding in unsteady cylinder flow even starting from a randomly initialized network.
Lev: And for the 2D lid-driven cavity flow, they got excellent agreement with reference data up to Reynolds numbers of seven thousand five hundred <ref:2511.18820#pg2>. That’s a big number for this kind of setup.
Kai: So, the authors are showing that even with all these constraint enforcement mechanisms in place, the baseline method isn't working on its own. This approach is a meshless flow solver where all the variables are just neural networks trained on randomly distributed points.
Mira: It shows that this formulation is robust across three dee Beltrami flow and both steady and unsteady two-dimensional cylinder flows. But Lev, how much real hardware overhead are we talking about for someone trying to actually run this thing?
Lev: The training cost is roughly two orders of magnitude higher than conventional solvers, which is a massive hurdle when you're thinking about putting this on real hardware.
Kai: So, the main point here is that they’ve created a robust foundation for future extensions toward complex moving boundaries and inverse problems in fluid flow. It shows that we might be able to get better results without relying on pre-existing data, which is a big deal for many applications.
Mira: It suggests that baking these physical constraints directly into the loss function is the way forward if we want neural networks to handle incompressible flows reliably. But Lev, what's next? Where does this lead us after they’ve proven it works on these specific benchmarks?
More episodes
- 2611.14082-Two atoms with strong light-induced dipolar interactions
- 2611.14040-Characterization of BNLs 20 and 30 micrometer thick LGADs for the Electron Ion Collider
- 2611.13399-Lift-element-based dynamic network of vortex gust-airfoil interactions
- 2611.13476-Hopfion Superlattices in 3D Twisted Moir'e Light Fields
- 2611.13642-Investigation of the timing performance of double-sided p-type 3D silicon sensors produced by CNM
- 2611.13830-SiPM optical readout of a PICOSEC Micromegas precise timing detector
- 2611.14152-Where are the shortest-path nodes in spatial networks?
- 2611.14219-Sub-Ice: semi-automated mapping of basal channels from ice shelf surface elevation data
- 2611.16341-SUMNO: Spatially Unrolled Multigrid Neural Operator for Fluid Flow Surrogates
- 2611.16090-Multi-UTE Myelin Fraction Mapping: Repeatability and Cross-Field-Strength Reproducibility at 1.5T and 3T