Deflation-PINNs: Learning Multiple Solutions for PDEs and Landau-de Gennes
math.NA, cs.LG, cs.NA
Submitted: 2026-03-30
Updated: 2026-08-28
Code: https://github.com/SeanDisaro/DeflationPINNs
License: http://creativecommons.org/licenses/by-nc-nd/4.0/
The gist: Nonlinear Partial Differential Equations (PDEs) are ubiquitous in mathematical physics and engineering.
Terminology
Abstract
Nonlinear Partial Differential Equations (PDEs) are ubiquitous in mathematical physics and engineering. Although Physics-Informed Neural Networks (PINNs) have emerged as a powerful tool for solving PDE problems, they typically struggle to identify multiple distinct solutions, since they are designed to find one solution at a time. To address this limitation, we introduce Deflation-PINNs, a novel framework that integrates a deflation loss with an architecture based on PINNs and Deep Operator Networks (DeepONets). By incorporating a deflation term into the loss function, our method systematically forces the Deflation-PINN to seek and converge upon distinct finitely many solution branches. We provide theoretical results on the approximation capabilities of our model and demonstrate the efficacy of Deflation-PINNs through numerical experiments on the Landau-de Gennes model of liquid crystals, a system renowned for its complex energy landscape and multiple equilibrium states, and on an Allen--Cahn benchmark whose solution set is provably known. Our results show that Deflation-PINNs can successfully identify and characterize multiple distinct crystal structures: a single unsupervised run recovers all six stable states of the benchmark, each branch certified to lie in the basin of attraction of a different equilibrium, and the discovered branches are refined to percent-level accuracy by a purely neural Deflation--Deep-Ritz stage and to the accuracy of a mesh-converged reference by a classical solver that they initialize.
Sources
- Operator Learning at Machine Precision
- The Deep Ritz method: A deep learning-based numerical algorithm for solving variational problems
- Variational Physics-Informed Neural Networks For Solving Partial Differential Equations
- Error estimates for DeepOnets: A deep learning framework in infinite dimensions
- Physics Informed Deep Learning (Part I): Data-driven Solutions of Nonlinear Partial Differential Equations
- Physics Informed Deep Learning (Part II): Data-driven Discovery of Nonlinear Partial Differential Equations
- Neural Network-Based Tensor Model for Nematic Liquid Crystals with Accurate Microscopic Information
- Inferring turbulent velocity and temperature fields and their statistics from Lagrangian velocity measurements using physics-informed Kolmogorov-Arnold Networks
- An Expert's Guide to Training Physics-informed Neural Networks
- Learning and discovering multiple solutions using physics-informed neural networks with random initialization and deep ensemble
Related papers
- Do physics-informed neural networks (PINNs) need to be deep? Shallow PINNs using the Levenberg-Marquardt algorithm
- A Neural-preconditioned Poisson Solver for Mixed Dirichlet and Neumann Boundary Conditions
- Advanced Linear Algebra with Applications - Part I (Numerical linear algebra for PDEs, machine learning, and data assimilation)
- Operator learning meets inverse problems: A probabilistic perspective
- Second-order consistency for learning chaotic dynamics via randomized Jacobian matching
- Windowed thinning and query complexity for the bouncy particle and Zigzag samplers