Development and performance of a transformer-based lepton isolation algorithm with the ATLAS experiment

summary

The gist

The Prompt Lepton Isolation Tagger (PLIT) is a transformer-based algorithm developed to distinguish prompt leptons (electrons and muons) originating from electroweak gauge boson decays from…

In short

PLIT is a transformer-based algorithm designed to separate prompt leptons from non-prompt ones, like those from hadron decays. It uses information from associated tracks and lepton properties within a neural network architecture similar to GN2. PLIT shows superior performance over previous methods, offering better rejection of background while maintaining high efficiency for identifying prompt leptons.

Key concepts

Prompt Lepton Isolation Tagger (PLIT)
A transformer-based algorithm developed to distinguish prompt leptons from non-prompt ones originating from hadron decays. It uses associated charged-particle tracks and lepton properties within a neural network to find correlations that improve discrimination.
Transformer Neural Network
The core machine learning architecture used in PLIT, adapted from the GN2 transformer used for heavy-flavor jet tagging. This network processes kinematic and detector data of the lepton along with information from up to 40 tracks within a small cone around the candidate lepton.
Discriminant ($D_{ ext{PLIT}}$)
The final output score calculated by PLIT, defined as the logarithm of the ratio between the probability that a lepton is prompt and the probability that it is not prompt. This value is used to classify whether a detected lepton originates from an electroweak decay or a hadronic decay.
Data-to-Simulation Efficiency Correction Factors (SFs)
Calibration factors derived by applying standard tag-and-probe methods to $Z o l^+l^-$ events. These factors are used to correct the efficiency measured in simulated data, helping to map simulation results accurately onto real experimental measurements.

Terminology used across episodes

This episode discusses

The paper

Development and performance of a transformer-based lepton isolation algorithm with the ATLAS experiment · Read on arXiv

The ATLAS Collaboration

EUROPEAN ORGANISATION FOR NUCLEAR RESEARCH (CERN)

The Prompt Lepton Isolation Tagger (PLIT) is a transformer-based algorithm designed to distinguish prompt leptons (electrons and muons) produced in the primary decays of electroweak gauge bosons from non-prompt leptons produced in hadron decays and from misidentified leptons. It is primarily used in measurements targeting multilepton final states with important backgrounds from non-prompt and misidentified leptons. PLIT exploits information from charged-particle tracks associated with the lepton candidate, together with lepton properties, using a transformer neural network to identify correlations between the tracks and improve the discrimination. Its performance is evaluated using simulated top-quark pair production events and compared with that of previously used lepton isolation algorithms, demonstrating improved prompt lepton efficiency while maintaining high rejection of non-prompt leptons. This article presents the development, performance, and calibration of PLIT for electrons and muons in proton--proton collisions at a centre-of-mass energy of sqrt s =13.6 TeV recorded by the ATLAS experiment at the Large Hadron Collider. Operating points are defined for both electrons and muons, and their efficiencies are calibrated using Z to l+l- events in Run 3 data, providing data-to-simulation correction factors for physics analyses.

Transcript

Introduction to the show: ident: High Energy Physics: Experiment. The day in high-energy experiment: detectors, searches and limits.

Kai: We're looking at the paper: "Development and performance of a transformer-based lepton isolation algorithm with the ATLAS experiment".

Mira: Here's the gist of the paper. The Prompt Lepton Isolation Tagger (PLIT) is a transformer-based algorithm developed to distinguish prompt leptons (electrons and muons) originating from electroweak gauge boson decays from non-prompt leptons arising from hadron decays and misidentified leptons.

Kai: PLIT leverages information from associated charged-particle tracks, combined with lepton properties, utilizing a transformer neural network to identify correlations that enhance discrimination.

Mira: Its performance was evaluated using simulated topquark pair production events against existing lepton isolation algorithms, demonstrating superior prompt lepton efficiency while maintaining high rejection of non-prompt leptons.

Kai: PLIT is specifically designed to separate prompt leptons from those predominantly produced in semileptonic decays of heavy-flavor hadrons.

Paper summary: Kai: So we’re looking at this paper now, "Development and performance of a transformer-based lepton isolation algorithm with the ATLAS experiment." It's about this new tool called PLIT, which is a transformer based algorithm designed to separate prompt leptons from non-prompt ones.

Mira: Right. The core idea here is using a transformer neural network to look at the tracks around a lepton candidate along with its properties to find correlations that help discriminate between the two sources of leptons. It's being used in measurements where you have lots of leptons, and you need to reject those from heavy-flavor hadron decays.

Lev: From my side, I'm interested in how much real hardware overhead this thing adds. The paper says they trained it on substantially larger simulated topquark pair production events compared to previous methods, which is a big data effort for a machine learning model like this.

Kai: Exactly. They used these larger samples to improve the discrimination between prompt leptons and those coming from semileptonic decays of heavy-flavor hadrons. This is directly aimed at reducing that single largest systematic uncertainty in the ATLAS measurement of the topquark pair production process, which was that non-prompt lepton background.

Mira: The paper claims PLIT demonstrates improved prompt lepton efficiency while maintaining a high rejection of those non-prompt leptons when compared to existing algorithms. It seems to be tackling this problem by looking at how tracks are associated with the lepton candidate within a cone of less than zero point four radians in radius.

Lev: That track information is key, and I wonder what the computational cost really is when you have up to forty tracks being fed into this transformer network for every candidate. We need to make sure that overhead doesn't swamp the actual physics signal we are looking for on real hardware.

Kai: The architecture itself is based on the GN2 transformer architecture that ATLAS uses for heavy-flavor jet tagging, but they adapted it specifically for lepton isolation. This means they’re using a well-established structure but applying it to this new task of lepton separation.

Paper summary: Mira: And the output of this network is a probability, p prompt, and then they build their final discriminant by taking the logarithm of the ratio between that probability and one minus that probability. That way you get their final PLIT discriminant, D PLIT = (p prompt / (one - p prompt)) <ref:2611.08194#pg2>.

Lev: So they’re moving from a BDT approach to something based on a transformer architecture for the isolation task. That shift in methodology suggests they are looking for more complex, non-linear correlations between the lepton and its surrounding activity.

Kai: And the performance claims are quite specific. For muons at low transverse momentum, they say the rejection is one point five to two times larger than PLIV for any given efficiency level.

Mira: And for electrons, they report a rejection gain of a factor of two or more across both p T ranges. Specifically, at low efficiency, that electron rejection can reach a factor of five for endcap electrons.

Lev: That’s interesting because the performance gains are varying by lepton type and by kinematic region. It shows the model isn't universally better everywhere; it has different strengths depending on what you are looking at.

Kai: And in terms of efficiency for the same rejection level, they show relative improvements of ten percent for muons, fifty percent for barrel electrons, and a hundred percent improvement for endcap electrons at low p T.

Mira: These relative efficiency gains are significant because they show that PLIT doesn't just reject more background; it also lets you keep more of the actual prompt signal. That is important when you are trying to measure things precisely.

Lev: The paper does mention that operating points were defined and their efficiencies calibrated using data with the standard tag-and-probe method applied to Z to l plus l minus events, which gives them those data-to-simulation correction factors, or SFs.

Kai: That calibration process is crucial for translating the simulation results into what we can actually expect in real detector data. And it seems the dominant uncertainty they found comes from modeling the hadronic activity in the simulation itself—specifically the difference between nominal Powheg plus Pythia and an alternative Sherpa sample.

Paper summary: Mira: That MC modeling issue is a known hurdle, but they state that all other systematic uncertainties, like template shape or QCD multijet background description, stay below one point zero percent across the whole transverse momentum range.

Lev: So the main remaining challenge for this algorithm’s performance seems to be how well we can model those underlying hadronic interactions in our simulations. That points toward future work focusing on better modeling of those specific processes.

Kai: This paper presents the development, performance, and calibration of PLIT, which is a transformer based lepton isolation algorithm designed to distinguish prompt leptons from non-prompt ones produced in hadron decays using information from associated charged-particle tracks and lepton properties.

Mira: The authors are showing that this approach leads to improved prompt lepton efficiency while maintaining high rejection of non-prompt leptons when compared with existing algorithms, using simulated topquark pair production events.

Lev: Ultimately, they’re showing how to use a transformer network adapted from jet tagging to solve the specific problem of lepton isolation in a way that improves background suppression in multilepton final states.

Kai: Looking at the title and authors, it seems like this work is focused on developing a new technique to handle the significant non-prompt lepton background that plagues measurements at the LHC when you're looking for prompt leptons.

Mira: It suggests a direction where leveraging transformer networks on track information can provide a more powerful way to isolate genuine electroweak boson decays from the much larger background from heavy-flavor hadron decays.

Lev: For running this on real hardware, it means we need to figure out how efficiently we can extract those forty tracks and feed them into that network without introducing too much latency or requiring excessive memory.

Kai: So, the implication is that if this method holds up in data as well as in simulation, it gives us a better way to measure the properties of top quark pair production events by cleaning up the final state lepton sample.

Conclusion: Kai: So we're looking at this paper about PLIT, which is a transformer based algorithm from the ATLAS experiment for separating prompt leptons from non-prompt ones, and it’s been really interesting to look at how they built and measured this stuff.

Mira: Yeah. The authors are showing that by using a neural network architecture adapted from jet tagging to isolate leptons, they can get better results than what we had before on simulated top quark pair production events.

Lev: From my side, it’s interesting because they trained this thing on much larger simulated samples than previous methods, which is a big data effort for training a transformer like this.

Kai: Right. The paper shows that even though the architecture is based on something used for jet tagging, they successfully adapted it for lepton isolation using track information around the candidate lepton.

Mira: It means they are leveraging those forty tracks within a small radius, less than zero point four radians, to find correlations that help discriminate between prompt and non-prompt leptons.

Lev: And from an engineering view, the network outputs a probability for a prompt lepton, and they build their final discriminant by taking the logarithm of the ratio between that probability and one minus that probability.

Kai: The performance numbers are pretty detailed too. They show gains for muons at low transverse momentum and significant rejection improvements for electrons across different kinematic regions.

Mira: It’s also important because they calibrated these operating points using data from Z to lepton pairs, which gives them correction factors to translate simulation into what we actually see in the detector.

Lev: The main caveat they flag is modeling the hadronic activity in their simulations, specifically how Powheg plus Pythia compares to a different sample like Sherpa.

Kai: So what this paper really means is that using these transformer networks on track information gives us a new way to clean up the final state leptons from top quark measurements by suppressing those non-prompt background sources.

Mira: It suggests we can push the limits of what we can measure in processes like top quark pair production if we can get the simulation modeling of hadronic activity right.

Lev: And it opens up a path for using transformer networks in other areas where complex correlations between many particles are needed, which is something I’m always interested in exploring for real hardware.

More episodes

← Home