Emergent Transfer of a Physics Foundation Model from Simulation to Laboratory Turbulence
summary
The gist
Foundation models, pretrained on large, diverse datasets and adapted via finetuning, exhibit a key property of transfer…
In short
The study tested if a physics foundation model, Walrus, trained only on simulations could predict real laboratory experiments involving the Rayleigh-Taylor instability (RTI). The model was finetuned and showed it could generalize from idealized simulation data to observed experimental growth rates ($\alpha \approx 0.07$) and even correctly predict behavior in unseen physical regimes like stable stratification.
Key concepts
- Rayleigh-Taylor Instability (RTI)
- RTI is a fluid instability where a lighter fluid accelerates into a heavier one, causing small initial density perturbations to grow into chaotic, multiscale mixing. It is a fundamental phenomenon observed in everything from tabletop flows to supernova explosions.
- Simulation-Experiment Gap
- This refers to the long-standing discrepancy where idealized Direct Numerical Simulations (DNS) of RTI predict a slower growth rate ($\alpha \approx 0.02$) than what is measured in actual laboratory experiments ($\alpha \approx 0.06-0.07$). The paper investigates if foundation models can bridge this gap.
- Foundation Model Transfer
- This involves taking a large model pretrained on broad simulation data and adapting it through finetuning to perform well on a new, sparse, or noisy task—in this case, transferring knowledge from simulations to real laboratory conditions without extensive new experimental training data.
Terminology used across episodes
This episode discusses
- Emergent Transfer of a Physics Foundation Model from Simulation to Laboratory Turbulence · Paper Radio
- PINNacle: A Comprehensive Benchmark of Physics-Informed Neural Networks for Solving PDEs
- MORPH: PDE Foundation Models with Arbitrary Data Modality
- PhysiX: A Foundation Model for Physics Simulations
- Test-time Generalization for Physics through Neural Operator Splitting
- U-Net: Convolutional Networks for Biomedical Image Segmentation
- Learning Turbulent Flows with Generative Models: Super-resolution, Forecasting, and Sparse Flow Reconstruction
The paper
Emergent Transfer of a Physics Foundation Model from Simulation to Laboratory Turbulence · Read on arXiv
Payel Mukhopadhyay, Stefan S. Nixon, Romain Watteaux, Michael McCabe, Alberto Bietti, Kyunghyun Cho, Cristiana Diaconu, Irina Espejo Morales, David Fouhey, Siavash Golkar, Tom Hehir, §hirlie Ho3,4,5,9,, Èraud Krawezik ´3,9,, Franc¸ois Lanusse7,9,, Tanya Marwah9,, Rudy Morel3,9,, Mariel Pettee8,9,, Helen Qu3,9,, Jeff Shen5,9,, Ádi Sotoudeh1, Øud B. Dalziel1, Íles Cranmer1, Geraud Krawezik ´3,9,, Franc¸ois Lanusse7,9,, Tanya Marwah9,, Rudy Morel3,9,, Mariel Pettee8,9,, Helen Qu3,9,, Ádi Sotoudeh1, Øud B. Dalziel1, Íles Cranmer1
University of Cambridge · CEA DAM/DIF · Flatiron Institute · New York University · Princeton University · Yale University
Transcript
Introduction to the show: ident: Physics. The day in general physics: instruments, methods and results across the field.
Kai: I'm Kai.
Mira: And I'm Mira, here with Lev.
Kai: We're looking at the paper: "Emergent Transfer of a Physics Foundation Model from Simulation to Laboratory Turbulence".
Mira: Here's the gist of the paper. Foundation models, pretrained on large, diverse datasets and adapted via finetuning, exhibit a key property of transfer: representations learned during pretraining generalize to new settings, reducing reliance on task-specific data.
Kai: This paradigm is being tested in the physical sciences regarding its applicability to laboratory experiments.
Mira: The study focuses on the Rayleigh-Taylor instability (RTI), where a discrepancy exists between idealized Direct Numerical Simulations (DNS) and laboratory experiments concerning the late-time mixing growth rate, alpha.
Kai: Standard machine learning models struggle with RTI, and the significant gap—laboratory rates being roughly three times higher than DNS values—serves as a stringent test for whether foundation models trained solely on simulations can generalize to sparse, noisy laboratory settings.
Paper summary: Kai: So to recap this paper on "Emergent Transfer of a Physics Foundation Model from Simulation to Laboratory Turbulence," the main question is whether physics foundation models can be usefully deployed on laboratory experiments at all.
Mira: They test this question using the Rayleigh-Taylor instability, which is this fluid instability where a lighter fluid sits above a heavier one and it erupts into complexity. The core thesis is that if models trained only on idealized simulations can generalize to real laboratory conditions they were never trained on, then their usefulness for actual physical discovery is fundamentally limited.
Lev: That limitation directly relates to the concept of simto-real transfer, which is how well a model performs when moving from simulation data to experimental data without any direct training on that experimental data.
Kai: The paper claims that by finetuning a foundation model, they can make it cross this divide. They show that models trained on idealized simulations can predict laboratory behavior and even unseen physical regimes, simply by having the right initial conditions or through careful adaptation.
Mira: What matters is that this isn't just about reproducing what was in the training set; it’s about generalising to new physical regimes that were never shown. They test this on RTI because it's a compelling system where the discrepancy between simulation and experiment is well-known, specifically regarding the late-time mixing growth rate alpha.
Lev: It matters because if we can get this transfer working robustly, it suggests that foundation models could be a new tool for exploring physical sciences where full simulations are too expensive or difficult to run.
Kai: Right, so they are looking at whether these models can bridge the gap between idealized simulation and the messy reality of lab experiments by learning physics from simulations and then adapting that learning.
Conclusion: Mira: So looking at the paper "Emergent Transfer of a Physics Foundation Model from Simulation to Laboratory Turbulence," it boils down to testing if we can trust these large models when they are applied outside their training environment, specifically in physical systems like fluid turbulence.
Kai: The authors suggest that the success here comes from finding this emergent transfer property. It means the model isn't just recalling simulation results; it’s learning a representation of physics that applies broadly.
Lev: What does this mean practically is that if we can get these models to work across different physical regimes, it changes how we think about using them for experimental science—it moves them from being just sophisticated data fitting tools to potential instruments for generating new physical insights.
Mira: So the implication is that we might be able to use foundation models as a way to quickly explore complex physical spaces where traditional simulation methods are too slow or computationally heavy.
Kai: It points toward a future where these models could help us bridge the gap between theoretical predictions and what we actually observe in the lab by learning from both worlds simultaneously, which is what they call simto-real transfer.
More episodes
- 2611.14082-Two atoms with strong light-induced dipolar interactions
- 2611.14040-Characterization of BNLs 20 and 30 micrometer thick LGADs for the Electron Ion Collider
- 2611.13399-Lift-element-based dynamic network of vortex gust-airfoil interactions
- 2611.13476-Hopfion Superlattices in 3D Twisted Moir'e Light Fields
- 2611.13642-Investigation of the timing performance of double-sided p-type 3D silicon sensors produced by CNM
- 2611.13830-SiPM optical readout of a PICOSEC Micromegas precise timing detector
- 2611.14152-Where are the shortest-path nodes in spatial networks?
- 2611.14219-Sub-Ice: semi-automated mapping of basal channels from ice shelf surface elevation data
- 2611.16341-SUMNO: Spatially Unrolled Multigrid Neural Operator for Fluid Flow Surrogates
- 2611.16090-Multi-UTE Myelin Fraction Mapping: Repeatability and Cross-Field-Strength Reproducibility at 1.5T and 3T