The Symbol of the Surrogate: Measuring Numerical Provenance in Neural PDE Solvers
cs.LG, math.AP, stat.ML
Submitted: 2026-10-07
Updated: 2026-10-07
Comments: Accepted at NeurIPS 2026 AI for Science Workshop
License: http://creativecommons.org/licenses/by/4.0/
The gist: Neural PDE surrogates are trained on numerical solver outputs that contain both physical evolution and solver-specific discretization errors.
Terminology
Abstract
Neural PDE surrogates are trained on numerical solver outputs that contain both physical evolution and solver-specific discretization errors. Because surrogates are also evaluated against held-out trajectories from the same solver, standard benchmarks cannot distinguish fidelity to the exact evolution from imitation of the numerical scheme. We introduce an empirical Fourier-symbol diagnostic that probes a trained surrogate's linearized one-step operator with individual Fourier modes and compares it with both exact-evolution and training-scheme references. To address architectural spectral bias, we train identical networks on schemes with orthogonal dissipative and dispersive signatures and compare their learned operators. In linear advection, the learned surrogates reproduce the training schemes' amplitude and phase errors, with the twin-scheme difference reaching more than 99.8% of the analytically predicted full-imitation ceiling. The same behavior occurs for a non-local Fourier neural operator and at the operator level for nonlinear Burgers dynamics. These results show that agreement with solver-generated test data does not by itself establish fidelity to the exact evolution. Fourier-symbol measurements provide a direct diagnostic of numerical provenance.
Sources
- Spectral Audit of In-Context Operator Networks
- Towards Multi-spatiotemporal-scale Generalized PDE Modeling
- Gaussian Error Linear Units (GELUs)
- Spectral bias in physics-informed and operator learning: Analysis and mitigation guidelines
- Deep Learning of Solver-Aware Turbulence Closures from Nudged LES Dynamics
Related papers
- Polynomial-Augmented Neural Networks (PANNs) with Weak Orthogonality Constraints for Enhanced Function and PDE Approximation
- AIRL-S: Unifying Reinforcement Learning and Search-Based Test-Time Scaling via Adversarial Inverse Reinforcement Learning
- Transformers as Bayesian In-Context Experimenters: Smoothness-Adaptive Efficient ATE Estimation
- Convergence issues in Relational Concept Analysis based on AOC-posets
- Beliefs Beyond Posteriors: The Predictive Cost of ELBO Binding
- Understanding Diffusion Models via Ratio-Based Function Approximation with SignReLU Networks