Fourier Neural Operators Explained: A Practical Perspective
cs.LG
Submitted: 2025-12-01
Updated: 2026-11-06
Comments: 104 pages, 29 figures
Code: https://github.com/neuraloperator/neuraloperator
License: http://creativecommons.org/licenses/by/4.0/
The gist: Partial differential equations (PDEs) govern a wide variety of dynamical processes in science and engineering…
Terminology
Abstract
Partial differential equations (PDEs) govern a wide variety of dynamical processes in science and engineering, yet obtaining their numerical solutions often requires high-resolution discretizations and repeated evaluations of complex operators, leading to substantial computational costs. Neural operators have recently emerged as a powerful framework for learning mappings between function spaces directly from data, enabling efficient surrogate models for PDE systems. Among these architectures, the Fourier Neural Operator (FNO) has become the most influential and widely adopted due to its elegant spectral formulation, which captures global correlations through learnable transformations in Fourier space while remaining invariant to discretization and resolution. Despite their success, the practical use of FNOs is often hindered by an incomplete understanding among practitioners of their theoretical foundations, practical constraints, and implementation details, which can lead to their incorrect or unreliable application. This work presents a comprehensive and practice-oriented guide to FNOs, unifying their mathematical principles with implementation strategies. We provide an intuitive exposition of the concepts of operator theory and signal processing that underlie the FNO, detail its spectral parameterization and the computational design of all its components, and address common misunderstandings encountered in the literature. The exposition is closely integrated with the NeuralOperator 2.0.0 library, offering modular state-of-the-art implementations that faithfully reflect the theory. By connecting rigorous foundations with practical insight, this guide aims to establish a clear and reliable framework for applying FNOs effectively across diverse scientific and engineering fields.
Sources
- Principled Approaches for Extending Neural Architectures to Function Spaces for Operator Learning
- Message Passing Neural PDE Solvers
- Neural operator surrogate models of plasma edge simulations: feasibility and data efficiency
- Neural Operator Learning for Ultrasound Tomography Inversion
- FC-PINO: High Precision Physics-Informed Neural Operators via Fourier Continuation
- Incremental Spatial and Spectral Learning of Neural Operators for Solving Large-Scale PDEs
- NeurOLight: A Physics-Agnostic Neural Operator Enabling Parametric Photonic Device Simulation
- Adaptive Fourier Neural Operators: Efficient Token Mixers for Transformers
- A Unified Model for Compressed Sensing MRI Across Undersampling Patterns
- A physics-encoded Fourier neural operator approach for surrogate modeling of divergence-free stress fields in solids
- Multi-Grid Tensorized Fourier Neural Operator for High-Resolution PDEs
- A Library for Learning Neural Operators
- Fourier Neural Operator Surrogate Model to Predict 3D Seismic Waves Propagation
- Geometric Operator Learning with Optimal Transport
- Fourier Neural Operator for Parametric Partial Differential Equations
- Neural Operator: Graph Kernel Network for Partial Differential Equations
- Enabling Automatic Differentiation with Mollified Graph Neural Operators
- Tipping Point Forecasting in Non-Stationary Dynamics on Function Spaces
- Neural Operators with Localized Integral and Differential Kernels
- DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operators
Related papers
- A Physics-Regulated Neural Framework for Learning 3D Grain Growth Dynamics
- FlexMoE: Learning One-for-All Multi-Budget Expert Pruning for Flexible MoE Deployment
- OptiMind: Improving Small Language Models for Optimization Modeling through Formulation Guidance and Multi-Turn Learning
- Staying in the Sweet Spot: Boost Reasoning Evolution via Responsive Rollout Difficulty Manipulation
- Examining the Impact of Data and Training Methods on Emergent and Subliminal Misalignment
- Rethinking Black-Box On-Policy Distillation: A Rubric-based Analysis