AeroJEPA: Learning Semantic Latent Representations for Scalable 3D Aerodynamic Field Modeling
cs.LG
Submitted: 2026-05-07
Updated: 2026-09-28
Code: https://github.com/NVIDIA/physicsnemo
License: http://creativecommons.org/licenses/by/4.0/
The gist: High-fidelity CFD is essential for aerodynamic design, but repeated simulations are computationally expensive, motivating surrogate models for rapid evaluation across geometries and operating
Terminology
Abstract
High-fidelity CFD is essential for aerodynamic design, but repeated simulations are computationally expensive, motivating surrogate models for rapid evaluation across geometries and operating conditions. Most existing surrogates are designed for direct field regression, requiring the evaluation of millions of field points even when only an aerodynamic quantity or a localized region is needed, while their internal representations are not intended for direct use in downstream tasks. We introduce AeroJEPA, a framework inspired by joint-embedding predictive architectures that represents the problem in two distinct latent spaces: context tokens encode geometry, while predicted tokens encode the aerodynamic state. Both representations remain directly accessible for downstream tasks, such as linear readouts of design variables and aerodynamic quantities without decoding and integrating the full field. When spatial detail is needed, a continuous implicit decoder evaluates the field only at the requested coordinates while reusing the encoded geometry. We evaluate AeroJEPA on HiLiftAeroML, with multi-million-point fields, and SuperWing, which spans a broad family of transonic wings. Compared with state-of-the-art direct-regression surrogates, AeroJEPA trades peak full-field accuracy for compact, reusable representations. In our selective-decoding experiment, however, AeroJEPA substantially outperforms the evaluated direct-regression surrogates while avoiding predictions over the remainder of the aircraft. The learned representations further support controlled interpolation, concept-vector arithmetic, and preliminary constrained latent-space optimization. These results show how predictive representations can support aerodynamic analysis with or without full-field reconstruction.
Sources
- GeoTransolver: Learning Physics on Irregular Domains Using Multi-scale Geometry Aware Physics Attention Transformer
- LeJEPA: Provable and Scalable Self-Supervised Learning Without the Heuristics
- HEP-JEPA: A foundation model for collider physics using joint embedding predictive architecture
- VL-JEPA: Joint Embedding Predictive Architecture for Vision-language
- Factorized Implicit Global Convolution for Automotive Computational Fluid Dynamics Prediction
- WirelessJEPA: A Multi-Antenna Foundation Model using Spatio-temporal Wireless Latent Predictions
- Value-guided action planning with JEPA world models
- Video Representation Learning with Joint-Embedding Predictive Architectures
- Cell-JEPA: Latent Representation Learning for Single-Cell Transcriptomics
- A-JEPA: Joint-Embedding Predictive Architecture Can Listen
- Learning and Leveraging World Models in Visual Representation Learning
- 3D-JEPA: A Joint Embedding Predictive Architecture for 3D Self-Supervised Representation Learning
- Learning Symmetry-Independent Jet Representations via Jet-Based Joint Embedding Predictive Architecture
- Rethinking JEPA: Compute-Efficient Video SSL with Frozen Teachers
- LeWorldModel: Stable End-to-End Joint-Embedding Predictive Architecture from Pixels
- DMT-JEPA: Discriminative Masked Targets for Joint-Embedding Predictive Architecture
- CrossJEPA: Cross-Modal Joint-Embedding Predictive Architecture for Efficient 3D Representation Learning from 2D Images
- Representation Learning for Spatiotemporal Physical Systems
- Graph-level Representation Learning with Joint-Embedding Predictive Architectures
- Joint Embedding Predictive Architectures Focus on Slow Features
Related papers
- Polynomial-Augmented Neural Networks (PANNs) with Weak Orthogonality Constraints for Enhanced Function and PDE Approximation
- AIRL-S: Unifying Reinforcement Learning and Search-Based Test-Time Scaling via Adversarial Inverse Reinforcement Learning
- Transformers as Bayesian In-Context Experimenters: Smoothness-Adaptive Efficient ATE Estimation
- Convergence issues in Relational Concept Analysis based on AOC-posets
- Beliefs Beyond Posteriors: The Predictive Cost of ELBO Binding
- Understanding Diffusion Models via Ratio-Based Function Approximation with SignReLU Networks