Equidistribution of Solution Gradients in Physics-Informed Neural Networks via Coordinate Transformations
math.NA, cs.AI, cs.LG, cs.NA
Submitted: 2026-11-06
Updated: 2026-11-06
Code: https://github.com/DUCH714/CTPINN
License: http://creativecommons.org/licenses/by/4.0/
The gist: Physics-Informed Neural Networks (PINNs) often struggle to approximate solutions with sharp gradients due to optimization difficulties and spectral bias.
Terminology
Abstract
Physics-Informed Neural Networks (PINNs) often struggle to approximate solutions with sharp gradients due to optimization difficulties and spectral bias. Motivated by the principle of gradient equidistribution from the stretching approach in grid generation, which redistributes solution gradients to reduce functional complexity, we propose Coordinate Transformation PINNs (CTPINNs), which incorporate learnable coordinate transformations to map the physical domain into a computational domain where the physical solutions become approximately affine, making them easier for neural networks to learn. We propose two constructions of the transformation: an explicit construction based on Majorants and an implicit construction based on invertable neural networks. Experimentally, the explicit construction can improve accuracy for PDEs with available explicit coordinate transformations, and the implicit construction can be combined with other advanced PINN models as an efficient plug-in module to improve performance across a range of challenging PDE benchmarks.
Sources
- PINNACLE: PINN Adaptive ColLocation and Experimental points selection
- Spectral Normalization for Generative Adversarial Networks
- Challenges in Training PINNs: A Loss Landscape Perspective
- Adversarial Adaptive Sampling: Unify PINN and Optimal Transport for the Approximation of PDEs
- Respecting causality is all you need for training physics-informed neural networks
- Random Weight Factorization Improves the Training of Continuous Neural Representations
- UGM2N: An Unsupervised and Generalizable Mesh Movement Network via M-Uniform Loss
Related papers
- Do physics-informed neural networks (PINNs) need to be deep? Shallow PINNs using the Levenberg-Marquardt algorithm
- A Neural-preconditioned Poisson Solver for Mixed Dirichlet and Neumann Boundary Conditions
- Advanced Linear Algebra with Applications - Part I (Numerical linear algebra for PDEs, machine learning, and data assimilation)
- Operator learning meets inverse problems: A probabilistic perspective
- Second-order consistency for learning chaotic dynamics via randomized Jacobian matching
- Windowed thinning and query complexity for the bouncy particle and Zigzag samplers