Multi-Objective Loss Balancing in Physics-Informed Neural Networks for Fluid Flow Applications
cs.CE
Submitted: 2025-09-17
Updated: 2025-10-05
Comments: 32nd IEEE International Conference on High Performance Computing, Data, and Analytics, India
Journal ref: 2025 IEEE 32nd International Conference on High Performance Computing, Data, and Analytics (HiPC)
DOI: 10.1109/HiPC66333.2025.00020
License: http://creativecommons.org/licenses/by/4.0/
The gist: Physics-Informed Neural Networks (PINNs) have emerged as a promising machine learning approach for solving partial differential equations (PDEs).
Terminology
Abstract
Physics-Informed Neural Networks (PINNs) have emerged as a promising machine learning approach for solving partial differential equations (PDEs). However, PINNs face significant challenges in balancing multi-objective losses, as multiple competing loss terms such as physics residuals, boundary conditions, and initial conditions must be appropriately weighted. While various loss balancing schemes have been proposed, they have been implemented within neural network architectures with fixed activation functions, and their effectiveness has been assessed using simpler PDEs. We hypothesize that the effectiveness of loss balancing schemes depends not only on the balancing strategy itself, but also on the loss function design and the neural network's inherent function approximation capabilities, which are influenced by the choice of activation function. In this paper, we extend existing solutions by incorporating trainable activation functions within the neural network architecture and evaluate the proposed approach on complex fluid flow applications modeled by the Navier-Stokes equations. Our evaluation across diverse Navier-Stokes problems demonstrates that this proposed solution achieves root mean square error (RMSE) improvements ranging from 7.4% to 95.2% across different scenarios. These findings highlight the importance of carefully designing the loss function and selecting activation functions for effective loss balancing.
Sources
Related papers
- Constrained Sensing and Reliable State Estimation with Shallow Recurrent Decoders on a TRIGA Mark II Reactor
- DREChanNet: Patient-Relative iEEG Model for Channel-Wise Epileptogenic Zone Localization
- A matrix-free, differentiable PyTorch solver for phase-field fracture: Formulation, benchmarks, and inverse analysis
- BizAgentBench: Unveiling Hidden Challenges in Deploying Long-Horizon Agents for Real-World Business
- Colour me shocked: Exact Molecular Hessians from local MLIPs in O(N) time using sparse differentiation!
- In-context learning as a retraining-free paradigm for constitutive modeling