Learning Scattering Amplitudes with Transformer Reinforcement Learning
summary
The gist
We introduce a transformer reinforcement learning algorithm that learns to solve high loop-level scattering amplitudes in planar N = 4 Super Yang-Mills theory Our algorithm improves on previous…
In short
The researchers developed a transformer reinforcement learning algorithm to solve high-loop scattering amplitudes in planar N=4 Super Yang-Mills theory. By incorporating known symmetries into the learning process, the model requires significantly less prior knowledge for training. The method uses sequential search guided by exact linear relations and Monte Carlo Tree Search (MCTS) to ensure all outputs adhere to known physical constraints.
Key concepts
- Planar N=4 SYM
- This is a specific type of quantum field theory that serves as a crucial testing ground for calculating scattering amplitudes. It possesses high symmetry, which simplifies the mathematical structure compared to more complex theories. The goal is to use this simplified structure to compute these amplitudes.
- Symbolic Representation (Form Factor)
- Scattering amplitudes are represented using a symbolic form factor notation, like S[F(L)], which involves sequences of letters and coefficients. While the total number of possibilities is huge, the actual space is very sparse due to strict adjacency constraints, making it manageable for learning.
- Sequential Search with MCTS
- The algorithm reconstructs the amplitude by having a transformer propose coefficient assignments. These assignments are then checked against exact linear relations derived from symmetries. If propagation alone isn't enough, Monte Carlo Tree Search (MCTS) explores alternatives to find consistent solutions.
Terminology used across episodes
This episode discusses
The paper
Learning Scattering Amplitudes with Transformer Reinforcement Learning · Read on arXiv
Institute for Gravitation and the Cosmos, Pennsylvania State University · School of Physical Science and Engineering, Tongji University, Shanghai, China · School of Computer Science, Georgia Institute of Technology, USA · School of Physics, Georgia Institute of Technology, USA · Lawrence Berkeley National Laboratory
We introduce a transformer reinforcement learning algorithm that learns to solve high loop-level scattering amplitudes in planar N = 4 Super Yang-Mills theory. Our algorithm improves on previous transformer-only results by incorporating previously derived symmetries and relationships into the learning algorithm. This results in a greatly decreased fraction of the solution that needs to be known a priori to solve the entire problem. An additional benefit is that our algorithm also ensures that every output obeys the set of known relationships. Rather than predicting all coefficients independently, the model proposes assignments that are propagated through exact linear relations, while MCTS searches over assignments when propagation alone is insufficient. This is crucial to the generalization of machine learning approaches to higher loops, as without this, there is no way to overcome the factorially scaling of state sizes and compare to results derived via other methods. Using the symbology representation of the form factor, we frame the problem as learning a mapping between discrete sequences and integer coefficients.
Transcript
Introduction to the show: ident: High Energy Physics: Theory. The day in high-energy theory: gravity, strings, fields and the questions left open.
Kai: We're looking at the paper: "Learning Scattering Amplitudes with Transformer Reinforcement Learning".
Mira: Here's the gist of the paper. We introduce a transformer reinforcement learning algorithm that learns to solve high loop-level scattering amplitudes in planar N = 4 Super Yang-Mills theory Our algorithm improves on previous transformer-only results by incorporating previously derived symmetries and relationships into the learning algorithm This results in a greatly decreased fraction of the solution that needs to be known a priori to solve the entire problem An additional benefit is that our algorithm also ensures that every output obeys the set of known relationships Rather than predicting all coefficients independently, the model proposes assignments that are propagated through exact linear relations, while MCTS searches over assignments when propagation alone is insufficient This is crucial to the generalization of machine learning approaches to higher loops, as without this, there is no way to overcome the factorially scaling of state sizes and compare to results derived via other methods.
Kai: Problem Formulation in QFT Scattering amplitudes are central objects in quantum field theory (QFT), encoding transition probabilities between asymptotic particle states Planar N = 4 Super Yang-Mills (SYM) theory has emerged as a key testing ground for such developments due to its high degree of symmetry and simplified analytic structure The difficulty of traditional perturbative computations based on Feynman diagrams scales factorially with both loop order and the number of external particles, motivating the development of alternative frameworks Recent work has shown that the symbolic structure of amplitudes can be treated as a sequence modeling problem, making it amenable to modern machine learning approaches such as transformers The shortcomings of this method are that it requires a vast majority of the final answer to be known so that it may be used as training data Furthermore, if one only greedily samples the resulting probability distribution, the outcome is almost guaranteed to violate the set of known relationships.
Mira: Symbolic Representation and Constraints The problem is framed as learning a mapping between discrete sequences and integer coefficients using the symbology representation of the form factor The L-loop symbol takes the form S
F(L): = X li1, …, li2L Cli1, …, li2L li1 ⊗ · · · ⊗ li2L, (1) The naive total number of possible words grows as 6(2L), leading to an exponential combinatorial explosion Despite the large combinatorial space, the symbol space is extremely sparse, and this sparsity is largely governed by adjacency constraints Forbidden adjacent pairs include the set of forbidden pairs such as one in
1: .
Kai: Words must be constructed with an alternating structure where (a, b, c) represents any string of letters “a”, “b”, or “c”, (d, e, f) represents a string of letters “d”, “e”, or “f” where only one of these characters is repeated.
Paper summary: Kai: So, wrapping up this discussion on "Learning Scattering Amplitudes with Transformer Reinforcement Learning," what's the bigger picture here for people outside of pure theory?
Mira: It shows that we can use these large language model architectures, like transformers, to tackle problems in quantum field theory where the state spaces are incredibly complex. They're not just guessing; they’re using learned patterns guided by known physical laws to find solutions that respect those laws.
Lev: It’s about showing how integrating structure—the known linear relations—into the learning pipeline actually makes the model better for extrapolation to higher loop orders, which is exactly where traditional methods hit a wall because of that factorial scaling.
Kai: The authors' work, using their transformer reinforcement learning approach to solve these amplitudes, suggests a viable path toward using machine learning for these kinds of calculations rather than just relying on massive, brute-force perturbative computations.
Mira: They’ve demonstrated that by structuring the problem as a sequential search where propagation handles most of the work and Monte Carlo tree search handles the difficult parts, you can reconstruct results with very little initial training data.
Lev: The paper points out a limitation, though: they mention adding a smaller set of constructed non-homogeneous relationships just to stop the transformer from outputting the trivial solution where all coefficients are zero. That’s an arbitrary constraint added for stability in the search.
Kai: So, while they show reconstruction up to loop order five with about five percent data, the method relies on those extra constraints to keep it from collapsing into a useless answer, which is a bit of an engineering patch.
Mira: It’s a practical demonstration that combining AI with established physical symmetries can be effective for exploring these high-dimensional spaces, even if you still need some careful tuning on those auxiliary rules.
Lev: For anyone thinking about implementing this kind of approach for real computational physics, the next step is figuring out how efficiently that MCTS search runs when the number of coefficients gets much larger than what they tested here. That’s where the real bottleneck is likely to be.
Kai: So, it’s a promising direction showing how transformer reinforcement learning can be steered by physical constraints to solve very hard problems in quantum field theory amplitudes.
Conclusion: Kai: So this paper is about using these transformer reinforcement learning algorithms to figure out those scattering amplitudes in planar N equals four super yang mian theory, which is some pretty hard quantum field theory stuff that usually involves a ton of tedious calculations.
Mira: Right, so the authors are showing how they can use transformers to learn the mapping between the symbols of these amplitudes and the actual integer coefficients, and they’re doing it by incorporating known symmetries into the learning process.
Lev: From an error correction standpoint, that incorporation of symmetry is key because it means we don't have to train on every single possible coefficient; we only need enough data to learn how those relationships connect things.
Kai: It sounds like they’re trying to bypass the need for knowing almost everything beforehand, which is a big deal when you look at the complexity scaling factorials in these amplitudes.
Mira: Exactly, and the way they structure it—where propagation handles most of the work and mcts explores alternatives—that's how they manage to get a complete result even when you only feed it a small fraction of the total data.
Lev: But I still have to ask, what happens when we move this from theory onto actual hardware? How much overhead does that sequential search and mcts add on top of what we’d need for real quantum error correction setups?
Kai: That’s the next thing to look at, right? Because if we can get the learning framework working on these symbols, it opens up a way to calculate things that are just too big for traditional computers.
More episodes
- 2606.30117-Gravitational Duals from Equations of State II: Large Hierarchies and False Vacua
- Daily Summary for 2026-11-19
- 2603.06575-An ode to instantons
- 2607.09594-Massless fermionic current of Schwinger pairs in 3D de Sitter spacetime
- 2508.13283-Algebraic traversable wormholes
- 2509.07838-Multi-Centered Black Hole Index from a Superconformal Quiver Index
- 2512.16596-Trace anomaly for a conformal 2D vector field model
- 2605.03155-Flat Space Physics from AdS Actions
- 2606.02707-Gravitational index, black hole saddle degeneracy, and one-form symmetry
- 2606.24008-General Lagrangian formulations for mixed-antisymmetric tensor fields on flat backgrounds