Generative sampling with physics-informed kernels
summary
The gist
Generative sampling with physics-informed kernels constructs a generative network for Monte-Carlo sampling in lattice field theories and beyond…
In short
This architecture creates a generative network for Monte-Carlo sampling in lattice field theories by computing layerwise propagation independently on each layer. It uses physics-informed renormalization group flows, which simplify the task into solving a set of independent, linear differential equations for kernels. This allows iterative refinement and structurally solves out-of-domain problems.
Key concepts
- Physics-Informed RG Flows
- This mechanism exploits the Wegner flow to transform the problem. Instead of solving for the probability distribution directly, it solves flows for generating functions, analytically fixing the action along this transformation. This simplifies the complex renormalization group equation into a simple linear differential equation for each kernel.
- Independent Kernels
- The architecture decomposes the global task of finding a map between two distributions into independent tasks at each time step. Each layer computes its own infinitesimal map, $\phi_t(\phi; F_t)$, based on the flow information, making the overall process more manageable.
- Out-of-Domain (OOD) Resolution
- The physics-informed RG pair $(S_t, \phi_t^<)$ provides error control for the transformation map. By locally improving the solution $\phi_t^<$ to satisfy a known linear differential equation, the architecture resolves high dimensionality and extrapolation issues common in generative models.
Terminology used across episodes
This episode discusses
- Generative sampling with physics-informed kernels · Paper Radio
- Trivializing maps, the Wilson flow and the HMC algorithm
- Variational Inference with Normalizing Flows
- Flow-based generative models for Markov chain Monte Carlo in lattice field theory
- Estimation of Thermodynamic Observables in Lattice Field Theories with Deep Generative Models
- Generative sampling with physics-informed kernels
- Physics-informed renormalisation group flows
- Renormalizing Diffusion Models
- Fourier-Flow model generating Feynman paths
- Detecting and Mitigating Mode-Collapse for Flow-based Sampling of Lattice Field Theories
- Learning Lattice Quantum Field Theories with Equivariant Continuous Flows
- Scaling of Stochastic Normalizing Flows in SU(3) lattice gauge theory
- Conditional Normalizing flow for Monte Carlo sampling in lattice scalar field theory
- Multilevel Generative Samplers for Investigating Critical Phenomena
- NETS: A Non-Equilibrium Transport Sampler
- Learning Interpolations between Boltzmann Densities
- Flow-based sampling for multimodal and extended-mode distributions in lattice field theory
- Neural Ordinary Differential Equations · Paper Radio
- Generalizable Equivariant Diffusion Models for Non-Abelian Lattice Gauge Theory
- Score-Based Generative Modeling through Stochastic Differential Equations
- Flow Matching for Generative Modeling
The paper
Generative sampling with physics-informed kernels · Read on arXiv
Friederike Ihssen, Renzo Kapusta, §Jan M. Pawlowski
Institut für Theoretische Physik, University Heidelberg · ExtreMe Matter Institute EMMI, GSI
We construct a generative network for Monte-Carlo sampling in lattice field theories and beyond, for which the layerwise propagation is computed and optimised independently on each layer. The architecture uses physics-informed renormalisation group flows that provide access to the layerwise propagation step from one layer to the next in terms of a simple first order partial differential equation for the respective renormalisation group kernel through a given layer. Thus, it transforms the generative task into that of solving once the set of independent and linear differential equations for the kernels of the transformation. As these equations are analytically known, the kernels can be refined iteratively. This allows us to structurally tackle out-of-domain problems generally encountered in generative models and opens the path to further optimisation. We illustrate the practical feasibility of the architecture within simulations in scalar field theories.
DOI: 10.22323/1.518.0055
Transcript
Introduction to the show: ident: High Energy Physics: Lattice. The day in lattice field theory: what the simulations put on the table.
Kai: We're looking at the paper: "Generative sampling with physics-informed kernels".
Mira: Here's the gist of the paper. Generative sampling with physics-informed kernels constructs a generative network for Monte-Carlo sampling in lattice field theories and beyond, where layerwise propagation is computed and optimized independently on each layer The architecture uses physics-informed renormalisation group flows that provide access to the layerwise propagation step from one layer to the next in terms of a simple first order partial differential equation for the respective renormalisation group kernel through a given layer Thus, it transforms the generative task into that of solving once the set of independent and linear differential equations for the kernels of the transformation As these equations are analytically known, the kernels can be refined iteratively This allows us to structurally tackle out-of-domain problems generally encountered in generative models and opens the path to further optimisation The core mechanism of the architecture The key idea underlying the physics-informed RG flows is to exploit the full generality of the Wegner flow (3) for the distribution or related RG equations for other generating functions Instead of solving the flows for the distribution p t(phi), one solves them for pairs F t(phi), phi t(phi) A key idea underlying the physics-informed RG flows
9: is to exploit the full generality of the Wegner flow (3) for the distribution or related RG equations for other generating functions The key point of the PIRG in this approach is to analytically fix the action S t along this transformation Then, the underlying renormalisation group equation is a simple linear differential equation for the kernel phi i at each time step Addressing out-of-domain challenges The architecture is designed to structurally resolve both of the OOD problems mentioned in the beginning The two OOD problems are: 1.
Kai: related to the high dimensionality of the transformation between the two theories, which grows with the number of lattice sites and typically renders the learned distribution inaccurate This originates in the fact that interpolation problems in high dimensions are equally ill-conditioned as extrapolation problems in low dimensions 2.
Mira: a standard extrapolation problem and may be explained as follows: assume that the generative model has been trained with a given samples size related to a limited information content Systematic error control through kernel refinement The properties of the PIK-architecture include: (i) Independent Kernels: PIKs convert the global task of finding a precise invertible map from the base distribution p0 to the final distribution p1 within a deep network into independent tasks of computing the infinitesimal maps phi t(phi; F t) at each time step (ii) OOD resolution: The Wegner equation (7) provides us with an error control of this map In particular, curing the OOD problem with the PIRG pair (S t, phi t<) boils down to locally improving the solution phi t< to a known linear differential equation (iii) Optimisation: The properties (i) and (ii) are relevant for the setup and solution of PIKs for a given pair (F t, phi t<) Practical implementation in scalar field theories In practice, the independent kernel structure is illustrated using a path for the action S t that connects a simple base distribution to the targeted one For zero-dimensional phi 4-theory, this involves choosing time-dependent mass m t and coupling lambda t to transport a Gaußian into a multimodal interacting theory The flow in RG-time is solved numerically by a standard fourth order Runge-Kutta scheme with a step size of Delta t = 1/25, leaving us with N t = 51 independent kernels phi<t to be determined Figure 2 shows a comparison of the targeted (orange) and modelled (black) zero-dimensional phi 4-theory distribution at the final time t = 1 Systematic improvement workflow To systematically improve the sampling, one computes the residual of (11) with an approximate kernel phi<(0)t A correction Delta phi<(0)t that satisfies L phi<Delta phi<(0)t(phi) = r(0) c(phi), will lead to a corrected kernel phi<(1)t = phi<(0)t + Delta phi<(0)t that solves the Wegner equation (11) accurately This procedure can also be iterated as the Wegner equation is linear in phi<t, hence the superscripts, indicating the first iteration Future directions and applications The paper concludes by outlining future applications of the PIK-architecture The first prominent direction is the application of PIKs to higher-dimensional field theories as well as the extension to field theories with gauge or fermionic degrees of freedom Moreover, as the PIK-architecture enables general transformations of the measure it is tailor-made to tackle sign problems, where the action becomes complex Furthermore, the PIK-architecture enables further optimisations of the sampling process Lastly, going beyond sampling, the PIK-architecture is also envisioned to infer the action or Hamiltonian in a symbolic way from data Acknowledgments We thank Gert Aarts, Kenji Fukushima, Sander Hummerich, Thore Kolja Joswig, Ullrich Köthe, Timoteo Lee, Manfred Salmhofer, Robert Scheichl, Lingxiao Wang and Kai Zhou for discussions and collaborations on related subjects We acknowledge the DM-LFT Collaboration for stimulating discussions and continuous support throughout this work It is funded by the Deutsche Forschungsgemeinschaft (DFG, German Research Foundation) under Germany’s Excellence Strategy EXC 2181/1 - 390900948 (the Heidelberg STRUCTURES Excellence Cluster) We also acknowledge support by the state of Baden-Württemberg through bwHPC References
1: U.
Kai: Wolff, CRITICAL SLOWING DOWN, Nucl.
Paper summary: Kai: So to summarize this paper, they are focusing on efficiently computing high-dimensional integrals that are usually done with Markov chain Monte Carlo approaches. They see critical slowing down and topological freezing as problems where traditional sampling algorithms lose their efficiency when you approach the continuum limit of the theory
one–three: <ref:2610.41864#pg2,the continuum limit of the theory 1–3>.
Mira: These problems mean the autocorrelation time of those Markov chains diverges, which requires huge amounts of computational resources to overcome. So, these models aim to find transformations that move configurations from a theory with efficient sampling to configurations of a targeted theory
four–seven: <ref:2610.41864#pg2,these models aim to find transformations that move configurations from a theory>.
Lev: The paper tackles two out-of-domain problems that hamper progress in generative Machine Learning models for Monte Carlo simulations of lattice field theories. First, it’s related to the high dimensionality of the transformation between two theories, which grows with the number of lattice sites and makes the learned distribution inaccurate
two–three: .
Kai: And second is a standard extrapolation problem, which they explain by saying that a generative model trained on a limited sample size has limited information content. This limits how far you can extrapolate to new regions.
Mira: The physics-informed approach addresses this by using the Wegner equation to provide an error control of the map between distributions. Specifically, using the physics-informed RG pair, they can locally improve that kernel solution phi to a known linear differential equation.
Lev: That means curing the out-of-domain problem boils down to locally improving that kernel solution phi to a known linear differential equation, which is really a concrete way of controlling the error eight.
Conclusion: Kai: So, looking at the title "Generative sampling with physics-informed kernels," this paper is essentially proposing a new way to sample from complex lattice theories by using these physics-informed flows. The authors are Ihssen, Kapust, and Pawlowski.
Mira: What they really mean is that instead of trying to map the entire distribution in one go, they break the mapping into independent steps governed by simple linear differential equations for each layer's kernel. This makes the process structurally solvable rather than just a black box learning task.
Lev: For practical hardware, this suggests a way to handle complex sampling where you can check and correct things layer by layer instead of getting stuck trying to solve the whole high-dimensional map simultaneously on real hardware eighteen. The complexity is managed because each step is linear in terms of the kernel update.
Kai: It opens up a path for further optimization because once you have those analytically known differential equations, you can refine those kernels iteratively. This iterative refinement is key to making the generative models more robust when they encounter problems outside of their training data.
Mira: The implications are that this architecture could be applied to higher-dimensional field theories or even theories with gauge or fermionic degrees of freedom twenty <ref:2610.41864#pg1>. Plus, since it allows for general transformations of the measure, it is specifically tailored to tackle sign problems where the action becomes complex.
Lev: And beyond just sampling, they envision using this architecture symbolically to infer the action or Hamiltonian directly from data. That moves it past just generating samples and into a potential tool for understanding the physics itself twenty-seven.
More episodes
- The day in conversation for 2026-11-19
- Daily Summary for 2026-11-19
- 2606.20029-Finite-Volume Step Scaling at Fixed Truncation in (2+1)D Hamiltonian U(1) Lattice Gauge Theory
- 2603.16266-Lattice QCD study of the K*(892) resonance at the physical point
- 2607.15742-Path optimization method for the sign problem: Insights from random matrix models
- The day in conversation for 2026-11-18
- Daily Summary for 2026-11-18
- Daily Summary for 2026-11-17
- 2608.18239-Searching for symmetric mass generation with staggered fermions in four dimensions
- The day in conversation for 2026-11-17