Lorentz-Equivariance without Limitations
summary
The gist
Lorentz Local Canonicalization (LLoCa) ensures exact Lorentz-equivariance for arbitrary neural networks with minimal computational overhead The paper introduces LLoCa…
In short
Lorentz Local Canonicalization (LLoCa) provides exact Lorentz-equivariance for any neural network with low computational cost. It works by predicting local reference frames for each particle and propagating tensor information between them. This enables state-of-the-art performance in tasks like amplitude regression and jet tagging, offering a fair comparison between equivariant and non-equivariant models.
Key concepts
- Local Reference Frames
- LLoCa predicts a specific local coordinate system for every input particle. This frame is constructed using four orthonormal unit vectors that define the local geometry of each particle's spacetime location. This allows the network to understand interactions relative to each particle's immediate environment.
- Lorentz Transformation Rule
- The paper defines how physical quantities, like vectors and tensors, must change when moving between different reference frames in special relativity. LLoCa uses this rule to ensure that the network's internal representations correctly transform when particles are moved or observed from different perspectives.
- Symmetry Breaking Strategies
- Sometimes a full Lorentz symmetry is too restrictive for the problem. LLoCa offers two ways to handle this: changing the network's architecture so it only respects a subgroup of the symmetry, or by adding specific input features that are only invariant under that smaller group.
Terminology used across episodes
This episode discusses
- Lorentz-Equivariance without Limitations · Paper Radio
- MadNIS -- Neural Multi-Channel Importance Sampling
- The Path to Proton Structure at One-Percent Accuracy
- AtlFast3: the next generation of fast simulation in ATLAS
- The Machine Learning Landscape of Top Taggers
- CaloChallenge 2022: A Community Challenge for Fast Calorimeter Simulation
- Model-agnostic search for dijet resonances with anomalous jet substructure in proton-proton collisions at sqrt s = 13 TeV
- Search for new physics in final states with semi-visible jets or anomalous signatures using the ATLAS detector
- Classifying Anomalies THrough Outer Density Estimation (CATHODE)
- Residual ANODE
- Semi-visible jets, energy-based models, and self-supervision
- The Landscape of Unfolding with Machine Learning
- Generative Unfolding with Distribution Mapping
- OmniFold: A Method to Simultaneously Unfold All Observables
- How to Unfold Top Decays
- Jet Diffusion versus JetGPT -- Modern Networks for the LHC
- Extrapolating Jet Radiation with Autoregressive Transformers
- ParticleNet: Jet Tagging via Particle Clouds
- Particle Transformer for Jet Tagging
- The Physics Behind ML-based Quark-Gluon Taggers
- Deep-learned Top Tagging with a Lorentz Layer
The paper
Lorentz-Equivariance without Limitations · Read on arXiv
Université catholique de Louvain Institute für Theoretische Physik Universität Heidelberg Interdisciplinary Center for Scientific Computing CERN
Lorentz Local Canonicalization (LLoCa) ensures exact Lorentz-equivariance for arbitrary neural networks with minimal computational overhead. For the LHC, it equivariantly predicts local reference frames for each particle and propagates any-order tensorial information between them. We apply it to graph networks and transformers. We showcase its cutting-edge performance on amplitude regression, end-to-end event generation, and jet tagging. For jet tagging, we introduce a large top tagging dataset to benchmark LLoCa versions of a range of established benchmark architectures and highlight the importance of symmetry breaking.
DOI: 10.21468/SciPostPhysCore.9.3.058
Transcript
Introduction to the show: ident: High Energy Physics: Phenomenology. The day in particle phenomenology: models, signatures and constraints.
Kai: We're looking at the paper: "Lorentz-Equivariance without Limitations".
Mira: Here's the gist of the paper. Lorentz Local Canonicalization (LLoCa) ensures exact Lorentz-equivariance for arbitrary neural networks with minimal computational overhead The paper introduces LLoCa, a framework that predicts local reference frames for each particle and propagates any-order tensorial information between them It is applied to graph networks and transformers, showcasing cutting-edge performance on amplitude regression, end-to-end event generation, and jet tagging Lorentz Local Canonicalization Mechanism LLoCa builds upon the concept of local canonicalization and extends it to Lorentz symmetry by predicting local reference frames for each input particle The construction of a local frame is achieved using four orthonormal unit vectors eaµ with the definition L = (3) and the transformation rule L'aµ = L aν (Λ−1) ν µ (5) Local frames constructed as in Eq.
Kai: (4) satisfy the required transformation behaviour of Eq.
Mira: (5) since L aµ = e aµ Λ→ L′aµ = e′aµ = e aν (Λ−1) ν µ = L a ν (Λ−1) ν µ, as by definition of the transformation rule of covectors The transformation behavior of Lorentz tensors in the LLoCa formalism is read off from their index structure, for example xµ Λ→ Λµν xν xµ Λ→ xν (Λ−1) ν fµν λ Λ→ Λµ σΛ ν κ fσγ (Λ−1) γλ x aL L(x L)aΛ→ (x L)a (fL) ab c Λ→ (fL) ab c Equivariance and Message Passing Lorentz-equivariance is achieved by transforming the input vector xµ into the local frame yielding the invariant object x aL = L aµ x µ (8) The output vector yµ is then transformed back to the global frame as yµ = (L−1) µa y aL (9) This leads to the output vector satisfying the correct transformation behavior yµ Λ→ y′µ = Λµν (L−1) ν a y aL = Λµν y ν For message passing networks, the tensorial message passing is generalized to f updated i,Li= ψ f i,Li N □ j=1 φ(mjj) (14) The received message mj,Li is related to the sender's frame by mj,Li = ρm(Li L−1j)mj,Lj (15) This generalization leads to the updated message f updated i,Li= ψ f i,Li N □ j=1 φ ρm(Li L−1j)mj,Lj (17) The scaled dot-product attention in the LLoCa framework is a special case of Eq.
Kai: (15), where the queries qLi are computed from latent features in the respective local frame and keys kLj are transformed by Li L−1j Symmetry Breaking Strategies Lorentz symmetry breaking is necessary when symmetry is realized only under a subgroup R of the full Lorentz group This can be done through two main approaches: 1.
Title and authors: Kai: Okay, so we're diving into the title and authors of this paper, "Lorentz-Equivariance without Limitations." The core idea here is that they are tackling the problem of achieving exact Lorentz equivariance for arbitrary neural networks while keeping the computational cost low.
Mira: I think the main point is that they introduce LLoCa, which is a framework designed to predict local reference frames for every particle and then propagate any order of tensorial information between them. It applies this to graph networks and transformers, showing it works well on amplitude regression, event generation, and jet tagging.
Lev: From my side in error correction terms, the part that interests me is the claim about minimal computational overhead because those frame conversions are usually where real hardware bottlenecks show up when you try to run these things.
Kai: That’s right. It’s not just about getting symmetry; it's about how they handle the transformation rules for these local frames and how they affect tensorial messages between particles, which is what makes the mechanism work.
Mira: And that tensorial message passing is quite powerful because it generalizes to message passing networks in a way that relates the received message back to what the sender's frame was by transforming it using rho m Li L minus one j mj,Lj.
Lev: If you take that generalization, the updated message f updated i,Li N squared j equals psi f i,Li N squared j plus phi rho m Li L minus one j mj,Lj and you see how it directly incorporates the frame transformation into the message update itself.
Kai: Precisely. And that leads to the output vector satisfying the correct transformation behavior under Lorentz transformations because of how everything is set up in equation nine.
Mira: So, they show that this setup ensures y mu lambda equals lambda mu nu L minus one a y a L, which is the correct transformation rule for the output vector when you transform it back to the global frame.
Lev: That’s crucial because without that correct transformation behavior, any symmetry you build up in the network architecture would be meaningless if it doesn't respect relativity.
Kai: So they’re showing that this structure is robust enough to handle arbitrary architectures, meaning you don't have to design a network specifically for this new method.
Mira: And they also address how to break the symmetry if you only care about a subgroup R of the full Lorentz group, which is where it gets more practical than just aiming for full symmetry all the time.
Lev: That’s where my experience comes in; it's much more useful when you have constraints on what your hardware can actually run, so knowing how to break equivariance down to a residual SO(two) group might be a practical way forward <ref:2508.14898#pg1>.
Kai: So they are not just proving the full symmetry thing, but providing tools for practical applications where you need to manage the complexity of Lorentz transformations in a constrained setting.
Mira: And that’s exactly what they seem to be doing with this paper, providing both the exact solution and a strategy for managing those subgroups.
The paper's summary: Kai: Now let's talk about what the paper actually summarizes in "Lorentz-Equivariance without Limitations." It boils down to LLoCa being a framework that uses learnable reference frames to build Lorentz-equivariant adaptations of any network architecture.
Mira: Essentially, it predicts these local frames for each particle and then propagates any order of tensorial information between those frames. This is applied to graph networks and transformers, and the results they showcase on amplitude regression, event generation, and jet tagging are very high quality.
Lev: I’d focus on the fact that they show that this method respects the structure of particle data by embedding these fundamental symmetries directly into the ML networks.
Kai: And they do this by using a learnable reference frame for each particle, which is what makes it local canonicalization, and then propagating those tensorial messages between those frames.
Mira: They are showing that this isn't just a theoretical curiosity; it works on concrete LHC problems like jet tagging where performance surpasses non-equivariant models.
Lev: And the key thing they point out is that they provide methods to handle the symmetry breaking, which means you can modify the network architecture or add specific inputs to control the residual symmetry group.
Kai: So, it’s not just a theoretical proof of full equivariance; it’s a practical method for embedding physics into machine learning models in a way that's flexible enough for real-world use.
Mira: The paper is about showing that you can embed fundamental symmetries in machine learning networks without sacrificing performance on the tasks we care about.
The paper's improvements: Lev: Regarding the improvements, they suggest two main ways to handle symmetry breaking, which we already talked about in detail earlier—architectural breaking and input-level breaking.
Kai: And I think one key improvement is that they allow for a fair comparison between different Lorentz-symmetry breaking approaches, which is something previous work hadn't really managed.
Mira: That's important because it lets users see how data augmentation emerges naturally as a byproduct of defining those reference frames, which you don't have to think about separately.
Lev: And for event generation, they say that having an architecture equivariant under the unbroken subgroup of the Lorentz group is sufficient for that task.
Kai: For jet tagging, they confirm that including symmetry breaking information at the input level is needed when you want optimal performance there.
Mira: So it’s not a one-size-fits-all solution; it depends entirely on whether you are doing event generation or jet tagging, right?
Conclusion: Kai: To wrap up, the main takeaway from "Lorentz-Equivariance without Limitations" is that LLoCa provides exact Lorentz equivariance at minimal computational cost for any network architecture.
Mira: It gives you a straightforward way to break or even remove it when symmetry is only realized under a subgroup of the Lorentz group, allowing for a fair comparison between exact equivariant networks and data augmentation.
Lev: For event generation, you just need an architecture equivariant under the unbroken subgroup of the Lorentz group for that task.
Kai: And for jet tagging, including symmetry breaking information at the input level seems necessary to get top performance there according to their findings when you look at the results.
Mira: So, as we conclude this discussion on "Lorentz-Equivariance without Limitations," it’s a framework that gives us exact Lorentz equivariance without adding massive computational costs for any network architecture.
Lev: It’s a framework that lets us compare standard and Lorentz-equivariant implementations fairly, and it enables users to easily modify the equivariance group.
More episodes
- 2610.38463-Gauge-parameter cancellation and finite form factors in one-loop quark scattering in the refined Gribov-Zwanziger framework
- 2610.37198-Searches for new particle physics by methods of classical and neutrino astronomy
- 2511.15779-SURFing to the Fundamental Limit of Jet Tagging
- 2505.01492-Photo- and Hadrodisintegration constraints on massive relics decaying into neutrinos
- 2505.20389-Dispersion relation of the neutrino plasma: Unifying fast, slow, and collisional instabilities
- 2511.10731-Keeping It Renormalizable: Minimal Baryogenesis induced Asymmetric Dark Matter
- 2404.04021-Vacuum correlations of the stress-energy-momentum tensor with constituent quarks
- 2503.02931-Relativistic Navier-Stokes description of the quark-gluon plasma radial flow
- 2606.06105-Bulk viscosity of a binary mixture: the role of the intra-species interaction
- 2607.03343-First look at the evaluation of two-loop Feynman integrals for radiative return processes