Neural Operator Surrogates for Landweber Iteration in Solving Inverse Problems
math.NA, cs.NA
Submitted: 2026-11-07
Updated: 2026-11-07
Code: https://github.com/Marco-IglesiasNottingham/neural-operator-landweber-reaction
License: http://creativecommons.org/licenses/by/4.0/
The gist: Neural operators can accurately approximate well-posed mappings, but for unbounded or discontinuous operators, common in inverse problems…
Terminology
Abstract
Neural operators can accurately approximate well-posed mappings, but for unbounded or discontinuous operators, common in inverse problems, we verify that their network parameters often blow up in architectures such as DeepONet and FNO. To solve inverse problems stably, we use Landweber iteration, which requires only a forward map and the adjoint of its derivative (linearisation). To reduce repeated PDE forward evaluations, we replace the forward operator and its derivative with a differentiable neural-operator surrogate. We show that encoder-network-decoder operators, including generalised DeepONets and fully coupled Fourier operators, approximate both the forward map and its derivative. A modified discrepancy principle ensures decreasing error before finite stopping. With a compact preconditioner, the iterates remain in a compact set where accurate surrogates exist, and the stopped reconstructions converge as data and surrogate errors vanish under a regularity condition. We also relate the theory to derivative-informed training along finite directions, showing that the preconditioner determines which derivative errors affect the Landweber iteration update. Experiments on identifying a reaction coefficient in an elliptic equation show that smoothing reduces late-iteration deterioration for less accurate surrogates but slows sharp-feature recovery, and that smaller derivative errors along training directions do not by themselves improve reconstruction accuracy.
Sources
- A neural operator view on U-Nets for inverse imaging problems
- Higher-Order Fourier Neural Operator: Explicit Mode Mixer for Nonlinear PDEs
- Universal Approximation of Nonlinear Operators and Their Derivatives
- Extension and neural operator approximation of the electrical impedance tomography inverse map
- Gaussian Processes and Kernel Methods: A Review on Connections and Equivalences
- Derivative-Informed Fourier Neural Operator: Universal Approximation and Applications to PDE-Constrained Optimization
Related papers
- Do physics-informed neural networks (PINNs) need to be deep? Shallow PINNs using the Levenberg-Marquardt algorithm
- A Neural-preconditioned Poisson Solver for Mixed Dirichlet and Neumann Boundary Conditions
- Advanced Linear Algebra with Applications - Part I (Numerical linear algebra for PDEs, machine learning, and data assimilation)
- Operator learning meets inverse problems: A probabilistic perspective
- Second-order consistency for learning chaotic dynamics via randomized Jacobian matching
- Windowed thinning and query complexity for the bouncy particle and Zigzag samplers