AlphaHits: Full-Event Tracking and Reconstruction Towards a Hit-Level Foundation Model
summary
The gist
AlphaHits introduces AlphaHits, a Transformer-based approach towards hit-level foundation models for LHC physics building on the TrackFormer and HiggsFormer architectures The model demonstrates…
In short
AlphaHits is a Transformer-based model designed for hit-level foundation models in LHC physics. It reconstructs full charged particles from raw detector hits, achieving a high TrackML score by using a shared representation to simultaneously perform multi-task reconstruction and classification.
Key concepts
- Hit-Level Foundation Models
- These are large AI models trained directly on raw detector hits instead of reconstructed particles. AlphaHits uses this approach to learn general physical representations from low-level data, which can then be reused for various physics tasks.
- TrackFormer Architecture
- This is the underlying Transformer structure used by AlphaHits. It is adapted to process detector hits, allowing it to perform assignments of inner-tracker hits to charged-particle trajectories, similar to how traditional trackers work but using a neural network.
- Multi-Task Learning from Shared Representation
- AlphaHits trains one backbone that learns a common representation from raw hits. This single representation is then used by multiple specialized heads to perform different tasks simultaneously, such as reconstructing tracks and classifying events.
Terminology used across episodes
This episode discusses
- AlphaHits: Full-Event Tracking and Reconstruction Towards a Hit-Level Foundation Model · Paper Radio
- Large Physics Models: Towards a collaborative approach with Large Language Models and Foundation Models
- TrackFormers: In Search of Transformer-Based Particle Tracking for the High-Luminosity LHC Era
- Hits to Higgs: Hit-Level Higgs Classification from Raw LHC Detector Data Using Higgsformer
- TrackFormers Part 2: Enhanced Transformer-Based Models for High-Energy Physics Track Reconstruction
- Prompting Particle Physics: Tokenized Multi-modal Foundation Models for Combinatorially Many Tasks · Paper Radio
- Particle Transformer for Jet Tagging
- Masked Particle Modeling on Sets: Towards Self-Supervised High Energy Physics Foundation Models · Paper Radio
- Finetuning Foundation Models for Joint Analysis Optimization
- Foundation model for particle collision data analysis · Paper Radio
- OmniJet- alpha: The first cross-task foundation model for particle physics
- Solving Key Challenges in Collider Physics with Foundation Models
- OmniLearned: A Foundation Model Framework for All Tasks Involving Jet Physics
- Aspen Open Jets: Unlocking LHC Data for Foundation Models in Particle Physics
- Machine-learned particle flow as a foundation model for collider physics · Paper Radio
- Performance of a Geometric Deep Learning Pipeline for HL-LHC Particle Tracking
- Towards a realistic track reconstruction algorithm based on graph neural networks for the HL-LHC
- Object condensation: one-stage grid-free multi-object reconstruction in physics detectors, graph and image data
- Reconstruct everything everywhere all at once: An end-to-end model for future colliders · Paper Radio
- High Pileup Particle Tracking with Object Condensation
- Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer
The paper
AlphaHits: Full-Event Tracking and Reconstruction Towards a Hit-Level Foundation Model · Read on arXiv
Sascha Caron, Nadezhda Dobreva, Polina Moskvitina, †Eugene Shalugin, Javad Sohrabi, Roberto Ruiz de Austri, ũue Zhao
National Institute for Subatomic Physics, The Netherlands · High-Energy Physics, Radboud University, The Netherlands · CERN, Switzerland · Instituto de Física Corpuscular, CSIC-Universitat de Valáncia · SURF
We introduce AlphaHits, a Transformer-based approach towards hit-level foundation models for LHC physics, building on the TrackFormer and HiggsFormer architectures. AlphaHits operates directly on detector hits and demonstrates scalable full-event charged-particle reconstruction and multi-task event reconstruction and classification from low-level detector information. AlphaHits-TrackFormer reconstructs the full charged-particle content of complete TrackML events without imposing a transverse-momentum selection on the target tracks. It processes both pixel and strip hits in events containing up to 1.5 times10 5 hits under HL-LHC-like pileup conditions and assigns hits to individual reconstructed trajectories across its kinematic range. This includes the challenging low- p T population down to approximately 150, MeV in TrackML samples. It achieves a TrackML score of 0.959 over all reconstructable tracks, representing, to our knowledge, the highest reported TrackML score for full-detector, inclusive charged-particle reconstruction. Building on the TrackFormer architecture, AlphaHits is pretrained on charged-particle tracking and fine-tuned for multi-task reconstruction and classification. From a shared hit-level representation, it predicts tracks, jets, jet flavour, and event-level observables. AlphaHits achieves an AUC of 0.944 for Higgs event classification, with performance comparable to a Particle Transformer (ParT) baseline using fully reconstructed inputs. It also achieves performance comparable to Delphes-based baselines for jet reconstruction, jet flavour classification, and missing transverse momentum regression. These results highlight the potential for scalable full-event tracking and multi-task learning directly from detector hits, representing a promising step towards transferable hit-level representations and general-purpose foundation models for LHC physics.
Transcript
Introduction to the show: ident: High Energy Physics: Experiment. The day in high-energy experiment: detectors, searches and limits.
Kai: We're looking at the paper: "AlphaHits: Full-Event Tracking and Reconstruction Towards a Hit-Level Foundation Model".
Mira: Here's the gist of the paper. AlphaHits introduces AlphaHits, a Transformer-based approach towards hit-level foundation models for LHC physics building on the TrackFormer and HiggsFormer architectures The model demonstrates scalable full-event charged-particle reconstruction together with multi-task event reconstruction and classification from low-level detector information.
Kai: Pruning redundant reasoning tokens AlphaHits operates directly on detector hits and demonstrates scalable full-event charged-particle reconstruction together with multi-task event reconstruction and classification from low-level detector information AlphaHits is pretrained on charged-particle tracking and fine-tuned for multi-task reconstruction and classification from a shared hit-level representation The model processes both pixel and strip detector hits in events containing up to 1.5 × 10 5 hits under HL-LHC-like pileup conditions AlphaHitsTrackFormer reconstructs the full charged-particle content of complete TrackML events without imposing a transverse-momentum selection on the target tracks AlphaHits achieves a TrackML score of 0.959 when evaluated inclusively over all reconstructable tracks representing, to our knowledge, the highest reported TrackML score for full-detector, inclusive charged-particle reconstruction Building on the TrackFormer architecture, AlphaHits is pretrained on charged-particle tracking and fine-tuned for multi-task reconstruction and classification from a shared hit-level representation From a shared hit-level representation, it predicts tracks, jets, jet flavour, and event-level observables How the training signal is built AlphaHits utilizes two complementary stages for training: Stage 1 trains the backbone as a Tracker from scratch using only tracking and hit-particle heads Stage 2 adds the other seven heads with fresh weights and trains them jointly, warm-started from the Stage 1 checkpoint The Stage 2 loss is a geometric mean over the six main tasks plus fixed-weight auxiliary terms The main tasks include event class, HT, E miss T, leptons, jets set (12 jet queries + flavour), and tracking token prediction Auxiliary terms are added with fixed weights outside the product to ensure a near-zero scaffold loss cannot collapse it Where the gains come from The performance gains stem from the combination of scalable full-event tracking with multi-task learning from shared hit-level representations AlphaHits achieves an AUC of 0.944 for Higgs event classification, demonstrating performance comparable to that of a Particle Transformer (ParT) baseline using fully reconstructed inputs The results point towards a common paradigm in which scalable sparse neural networks learn physically informative representations directly from detector measurements AlphaHits extends this approach to multi-task event reconstruction and classification exploring whether a common representation of low-level detector information can be reused across reconstruction and inference tasks Performance comparison against baselines AlphaHits achieves a TrackML score of 0.959 over all tracks (pT > 0.15 GeV) on the TrackML dataset AlphaHits reaches an AUC of 0.932 for Higgs event classification from silicon hits alone and 0.944 with calorimeter towers as an additional input The results show that AlphaHits finds all six GenJets with the right flavour when using hits only, matching the Delphes track-jet reference from 77 % b-efficiency on (light-jet rejection ratio 1.0, 1.0 and 1.3 at 77, 80 and 85 %; c-jet 1.0, 1.1 and 1.3) Together, these results establish scalable full-event tracking and multi-task learning as complementary steps towards general-purpose hit-level foundation models and Large Physics Models With larger-scale training and further developments, such approaches could ultimately enable end-to-end optimization of physics analyses directly from detector measurements potentially improving sensitivity beyond conventional reconstruction pipelines The objective is to optimize the analysis chain end-to-end for specific physics goals potentially surpassing the performance of conventional reconstruction pipelines and enabling sensitivity to signals that are currently difficult or impossible to reconstruct The focus of this work was the development of hit-level tracking and foundation models and their physics performance The one-shot model keeps the tracking head but reaches a TrackML score of 0.806 with the equal-token decode and a double-majority efficiency of 0.893 for pT > 1 GeV The towers improve the tracking (0.819, 0.897) The AlphaHits backbone is smaller than the AlphaHits-TrackFormer Tracker (12 instead of 18 layers, 9.7 M instead of 19.4 M parameters) and is trained on a different sample with a different codebook so the two tracking scores are not directly comparable The depth dependence of Figure 9 suggests that a deeper backbone would also lead to better tracking performance The authors acknowledge the assistance of large language models, including GPT-5, GPT-6, and Claude Opus for code generation, debugging, and implementation support The study builds on previous implementations of TrackFormer and HiggsFormer which were developed with the assistance of large language models including GPT-5, GPT-6, and Claude Opus for code generation The work was supported by the European Union ERDF and Comunitat Valenciana as well as technical support provided by the Instituto de F´ısica Corpuscular, IFIC (CSIC-UV) The paper is 2611.13222 AlphaHits-TrackFormer therefore processes the full pixel and strip hit cloud and attempts to reconstruct all reconstructable charged particles represented in the TrackML sample without imposing a pT threshold on the target tracks We further ask whether such hit-level representations can support tasks beyond charged-particle tracking AlphaHits extends this approach to multi-task event reconstruction and classification exploring whether a common representation of low-level detector information can be reused across reconstruction and inference tasks Page 6 --- Our earlier TrackFormer and HiggsFormer studies explored this idea from complementary directions TrackFormer investigated Transformer-based assignment of inner-tracker hits to charged-particle trajectories HiggsFormer showed that a related architecture could be retrained to classify Higgs events directly from raw inner-tracker hits bypassing explicit track and object reconstruction Trained on the raw inner-tracker hits of simulated ttH¯ (H → b¯b) and tt¯ events, it reached AUC of 0.855, comparable to what a Particle Transformer
5: on Delphes tracker objects reaches at the 40% b-tagging working point (0.852) This result suggested that models trained on low-level inputs can learn detector-hit representations which retain substantial information relevant not only to particle reconstruction but also to downstream physics inference Page 7 --- AlphaHits-TrackFormer reconstructs tracks in complete TrackML events of up to 1.5 × 10 5 hits A learned Router sparsifies the attention a global Tracker model predicts binned and continuous track parameters for every hit a charge-aware preconditioner and a learned Gate select the ambiguous regions and a local Refiner resolves them AlphaHits-TrackFormer reaches TrackML scores of 0.959 over all tracks (pT > 0.15 GeV) trained on 7830 events Page 8 --- The AlphaHits-TrackFormer reconstruction pipeline is hierarchical A learned Router first assigns detector hits to overlapping logical groups that determine the sparse attention structure A full-event Tracker then predicts track parameters for every hit and maps the hits into a discrete track-parameter space Finally, a learned Gate identifies regions that require additional processing and a compact local Refiner resolves the remaining combinatorial ambiguities Page 9 --- The Router is a small MLP that processes hits independently It receives the continuous hit features together with learned embeddings describing the detector volume layer and module and predicts membership in two of four × 4 × 32 groups made in hit-radius track-pseudorapidity and track-azimuth The Router therefore serves two purposes it makes full-event attention computationally tractable and introduces a learned locality structure determining which detector regions can communicate directly Page 10 --- Hits, used as an input are represented as short vectors of their position and local geometry They are embedded by one linear layer into d=256 vectors and passed through a stack of Transformer encoder layers The output of the encoder is one state per hit and every head of both models reads these per-hit states AlphaHits adds learned embeddings of the detector volume layer and module and eight cluster-shape features for every input hit Page 11 --- AlphaHits predicts, for every hit its particle’s kinematics, production-vertex displacement and charge, and its member jet’s axis pT and secondary-vertex flight distance next to the track token The auxiliary terms enter the loss with fixed weights outside the main objective Page 12 --- AlphaHits predicts for every hit its particle’s kinematics, production-vertex displacement and charge, and its member jet’s axis pT and secondary-vertex flight distance next to the track token The auxiliary terms enter the loss with fixed weights outside the main objective Page 13 --- AlphaHits is a permutation-equivariant Transformer architecture operating directly on detector hits building on the TrackFormer and HiggsFormer models The first HiggsFormer was an event classifier over raw hit coordinates (x, y, z) with a single ttH¯ (H → b¯b) vs tt¯ head plus an auxiliary HT regression head for the ‘big’ model Page 14 --- Each hit is the seven-dimensional vector: position in metres transverse radius azimuth as (cos φ,sin φ) and pseudorapidity The model sees positions only no detector identifiers cluster shape charge or timing Page 15 --- AlphaHits is a permutation-equivariant Transformer architecture operating directly on detector hits building on the TrackFormer and HiggsFormer models It is pretrained on tracking tasks only (Stage 1) and fine-tuned with nine heads to predict tracks, jets with flavour, HT, Emiss T, leptons and the event class in one forward pass (Stage 2) Page 16 --- The first HiggsFormer was an event classifier over raw hit coordinates (x, y, z) with a single ttH¯ (H → b¯b) vs tt¯ head plus an auxiliary HT regression head for the ‘big’ model AlphaHits builds on the tracking backbone of Section 4 Page 17 --- All training of the AlphaHits-TrackFormer models was conducted on an NVIDIA H200 card and took roughly 1 week for the best model The Router is first pretrained for one epoch using only the supervised routing objective The Router and Tracker are subsequently trained jointly for 50 epochs using the AdamW optimizer with an initial learning rate of 3 × 10-4, weight decay of 1 × 10-4, and cosine learning-rate annealing Page 22 --- The Router is supervised through Lrouter a soft-target cross-entropy loss over the 512 routing groups The global stage is trained with a multi-task objective combining discrete track-parameter prediction, hit classification, continuous track-parameter regression, charge prediction, and routing supervision Page 24 --- The Router is supervised through Lrouter a soft-target cross-entropy loss over the 512 routing groups The global stage is trained with a multi-task objective combining discrete track-parameter prediction, hit classification, continuous track-parameter regression, charge prediction, and routing supervision Page 26 --- The Router is supervised through Lrouter a soft-target cross-entropy loss over the 512 routing groups The global stage is trained with a multi-task objective combining discrete track-parameter prediction, hit classification, continuous track-parameter regression, charge prediction, and routing supervision Page 27 --- The Router is supervised through Lrouter a soft-target cross-entropy loss over the 512 routing groups The global stage is trained with a multi-task objective combining discrete track-parameter prediction, hit classification, continuous track-parameter regression, charge prediction, and routing supervision Page 28 --- The Router is supervised through Lrouter a soft-target cross-entropy loss over the 512 routing groups The global stage is trained with a multi-task objective combining discrete track-parameter prediction, hit classification, continuous track-parameter regression, charge prediction, and routing supervision Page 29 --- The Router is supervised through Lrouter a soft-target cross-entropy loss over the 512 routing groups The global stage is trained with a multi-task objective combining discrete track-parameter prediction, hit classification, continuous track-parameter regression, charge prediction, and routing supervision Page 30 --- The Router is supervised through Lrouter a soft-target cross-entropy loss over the 512 routing groups The global stage is trained with a multi-task objective combining discrete track-parameter prediction, hit classification, continuous track-parameter regression, charge prediction, and routing supervision Page 31 --- The Router is supervised through Lrouter a soft-target cross-entropy loss over the 512 routing groups The global stage is trained with a multi-task objective combining discrete track-parameter prediction, hit classification, continuous track-parameter regression, charge prediction, and routing supervision Page 32 --- The Router is supervised through Lrouter a soft-target cross-entropy loss over the 512 routing groups The global stage is trained with a multi-task objective combining discrete track-parameter prediction, hit classification, continuous track-parameter regression, charge prediction, and routing supervision Page 33 --- The Router is supervised through Lrouter a soft-target cross-entropy loss over the 512 routing groups The global stage is trained with a multi-task objective combining discrete track-parameter prediction, hit classification, continuous track-parameter regression, charge prediction, and routing supervision Page 34 --- The Router is supervised through Lrouter a soft-target cross-entropy loss over the 512 routing groups The global stage is trained with a multi-task objective combining discrete track-parameter prediction, hit classification, continuous track-parameter regression, charge prediction, and routing supervision Page 35 --- The Router is supervised through Lrouter a soft-target cross-entropy loss over the 512 routing groups The global stage is trained with a multi-task objective combining discrete track-parameter prediction, hit classification, continuous track-parameter regression, charge prediction, and routing supervision Page 36 --- The Router is supervised through Lrouter a soft-target cross-entropy loss over the 512 routing groups The global stage is trained with a multi-task objective combining discrete track-parameter prediction, hit classification, continuous track-parameter regression, charge prediction, and routing supervision Page 37 --- The Router is supervised through Lrouter a soft-target cross-entropy loss over the 512 routing groups The global stage is trained with a multi-task objective combining discrete track-parameter prediction, hit classification, continuous track-parameter regression, charge prediction, and routing supervision Page 38 --- The Router is supervised through Lrouter a soft-target cross-entropy loss over the 512 routing groups The global stage is trained with a multi-task objective combining discrete track-parameter prediction, hit classification, continuous track-parameter regression, charge prediction, and routing supervision Page 39 --- The Router is supervised through Lrouter a soft-target cross-entropy loss over the 512 routing groups The global stage is trained with a multi-task objective combining discrete track-parameter prediction, hit classification, continuous track-parameter regression, charge prediction, and routing supervision Page 40 --- The Router is supervised through Lrouter a soft-target cross-entropy loss over the 512 routing groups The global stage is trained with a multi-task objective combining discrete track-parameter prediction, hit classification, continuous track-parameter regression, charge prediction, and routing supervision Page 41 --- The Router is supervised through Lrouter a soft-target cross-entropy loss over the 512 routing groups The global stage is trained with a multi-task objective combining discrete track-parameter prediction, hit classification, continuous track-parameter regression, charge prediction, and routing supervision Page 42 --- The Router is supervised through Lrouter a soft-target cross-entropy loss over the 512 routing groups The global stage is trained with a multi-task objective combining discrete track-parameter prediction, hit classification, continuous track-parameter regression, charge prediction, and routing supervision Page 43 --- The Router is supervised through Lrouter a soft-target cross-entropy loss over the 512 routing groups The global stage is trained with a multi-task objective combining discrete track-parameter prediction, hit classification, continuous track-parameter regression, charge prediction, and routing supervision Page 44 --- The Router is supervised through Lrouter a soft-target cross-entropy loss over the 512 routing groups The global stage is trained with a multi-task objective combining discrete track-parameter prediction, hit classification, continuous track-parameter regression, charge prediction, and routing supervision Page 45 --- The Router is supervised through Lrouter a soft-target cross-entropy loss over the 512 routing groups The global stage is trained with a multi-task objective combining discrete track-parameter prediction, hit classification, continuous track-parameter regression, charge prediction, and routing supervision Page 46 --- The Router is supervised through Lrouter a soft-target cross-entropy loss over the 512 routing groups The global stage is trained with a multi-task objective combining discrete track-parameter prediction, hit classification, continuous track-parameter regression, charge prediction, and routing supervision Page 47 --- The Router is supervised through Lrouter a soft-target cross-entropy loss over the 512 routing groups The global stage is trained with a multi-task objective combining discrete track-parameter prediction, hit classification, continuous track-parameter regression, charge prediction, and routing supervision Page 48 --- The Router is supervised through Lrouter a soft-target cross-entropy loss over the 512 routing groups The global stage is trained with a multi-task objective combining discrete track-parameter prediction, hit classification, continuous track-parameter regression, charge prediction, and routing supervision Page 49 --- The Router is supervised through Lrouter a soft-target cross-entropy loss over the 512 routing groups The global stage is trained with a multi-task objective combining discrete track-parameter prediction, hit classification, continuous track-parameter regression, charge prediction, and routing supervision Page 50 --- The Router is supervised through Lrouter a soft-target cross-entropy loss over the 512 routing groups The global stage is trained with a multi-task objective combining discrete track-parameter prediction, hit classification, continuous track-parameter regression, charge prediction, and routing supervision
Paper summary: Kai: So, looking at AlphaHits: Full-Event Tracking and Reconstruction Towards a Hit-Level Foundation Model, the main thrust is that using this Transformer approach directly on detector hits allows for scalable full event charged particle reconstruction alongside multi-task learning from those low level inputs.
Mira: It’s about proving that you can reuse a common representation of low level detector information across different physics objectives, which they explore through event reconstruction and classification tasks.
Lev: In simple terms, this means we might be able to optimize the entire analysis chain end-to-end by starting directly from the detector measurements instead of relying on a fixed pipeline.
Kai: The title emphasizes that it's about moving towards a hit level foundation model, suggesting these models could eventually allow for end-to-end optimization of physics analyses directly from detector measurements.
Mira: It suggests that with larger scale training and further developments, these approaches could potentially enable sensitivity beyond conventional reconstruction pipelines by optimizing the analysis chain specifically for particular physics goals.
Lev: The paper focuses on developing hit level tracking and foundation models and their performance in physics applications, which is a significant step toward that goal.
Conclusion: Kai: So we've seen how AlphaHits uses this Transformer to reconstruct full events directly from detector hits, and now we're at the conclusion of this paper about AlphaHits: Full-Event Tracking and Reconstruction Towards a Hit-Level Foundation Model.
Mira: Basically, they're saying that by training this model to do tracking and other tasks all at once from those raw hits, you can create a foundation model that works directly on detector measurements.
Lev: It seems like the authors are pushing the idea that this hit-level representation is useful not just for one thing, but for many different physics goals, like reconstruction and event classification.
Kai: Right, they're showing how they build this from scratch using two stages of training—first learning tracking on its own, then adding all those other heads to learn everything jointly.
Mira: And the results are pretty solid on the performance numbers they report for things like Higgs event classification, even when using only silicon hits initially.
Lev: But I always want to ask about how much overhead this model would actually take to run on real hardware, especially when you're dealing with pileup conditions as high as those at the HL-LHC.
Kai: Well, the paper mentions they tested it under conditions up to one point five times ten thousand hits and that's what they focused on for their main reconstruction test.
Mira: The implication here is that if you can learn these powerful representations from just the detector data, you might be able to optimize your entire analysis chain end-to-end.
Lev: That's a big change because it could mean moving away from those fixed reconstruction pipelines and tuning everything directly for a specific physics goal.
Kai: Exactly, they suggest that with bigger training sets and more work on this kind of approach, we might be able to improve sensitivity in ways that are currently just out of reach.
Mira: So it really boils down to whether a shared representation of low level detector information can truly be reused across both reconstruction and inference tasks.
Lev: That's the core question they're leaving open for future work, which is where the real engineering challenge will come in figuring out how to scale this up.
More episodes
- Daily Summary for 2026-11-19
- 2512.21290-Model-independent ZH production cross section at FCC-ee
- 2610.21982-First Observation of the Radiative Decay D 0 to gamma omega
- The day in conversation for 2026-11-19
- Daily Summary for 2026-11-19
- Daily Summary for 2026-11-18
- 2512.08065-Searches for Light Dark Matter and Evidence of Coherent Elastic Neutrino-Nucleus Scattering of Solar Neutrinos with the LUX-ZEPLIN (LZ) Experiment
- Daily Summary for 2026-11-18
- 2508.18022-Precision Measurements of the Electroweak Mixing Angle in the Region of the Z pole at the Large Hadron Collider
- 2512.23992-Prospect for measurement of CP-violating parameters of B s 0 to phi gamma at the Tera Z factory