CELEBI: Towards Reproducible and FAIR Physics Analysis
Listen
Radio episode about this paper
Transcript
Introduction to the show: ident: High Energy Physics: Experiment. The day in high-energy experiment: detectors, searches and limits.
Kai: We're looking at the paper: "CELEBI: Towards Reproducible and FAIR Physics Analysis".
Mira: Here's the gist of the paper. Celebi organizes reusable algorithms, tasks, and their dependencies into a structured workflow, preserves selected states as immutable impressions, and associates retained results with the states responsible for their production The paper introduces Celebi as an analysis-management framework that maintains a persistent connection between evolving analysis materials and their generated results System Architecture Celebi separates potentially large data products generated during execution from the lightweight materials defining a physics analysis, including code, configurations, parameters, documentation, and dependencies Its two main components are the Analysis Repository, which maintains the evolving analysis definition, and the Production Factory, which handles execution and generated results The middleware layer Yuki connects the two, allowing preserved analysis states to be executed and their results to be associated with the corresponding analysis definitions Analysis Organization Changes to inputs, algorithms, or configurations may require several downstream computations to be updated or repeated Celebi simplifies the management of such changes by explicitly representing analysis components and their dependencies Each component records its own dependencies, removing the need for a single, centrally maintained workflow description The system distinguishes between editable working analysis and immutable impressions Provenance Management Results are associated with immutable task impressions rather than treating them as independent output files These impressions identify preserved code and configuration, including task parameters, together with the exact impressions of upstream dependencies This allows the provenance of a result to be traced through the analysis When results remain retained, they can be inspected and compared together with their respective preserved analysis states Collaboration and Preservation Celebi organizes analysis materials, documentation, and dependencies into structured repository objects Collaborators can inspect a selected component together with its local documentation and dependencies, without first reconstructing the complete analysis from unrelated files Immutable impressions also give collaborators and reviewers stable references to particular analysis states This organization facilitates analysis handover and long-term preservation FAIR Principles Extension By associating results with identifiable analysis states, Celebi provides a foundation for finding and reusing analysis materials and outputs Its structured representation supports programmatic interpretation and can facilitate interoperability with other infrastructures The separation of analysis definitions from generated data facilitates their independent preservation This contributes to more transparent and reusable physics analyses Celebi simplifies the management of physics analyses throughout their lifecycle by organizing analysis components and their dependencies into a structured, modular representation Its modular organization and explicit dependencies make analysis components easier to modify, reuse, and reorganize Immutable impressions retain the link between generated results and the analysis states responsible for their production These capabilities support historical result inspection, collaboration, and review with less reliance on manual bookkeeping They also support systematic variations and controlled rerunning of preserved states provided that the required inputs, software environments, and execution infrastructure remain available Maintaining analysis states and provenance during everyday development also provides a natural starting point for long-term preservation In this way, Celebi offers a practical foundation for extending FAIR principles beyond research data to the computational analyses used to produce scientific results REFERENCES
3: F.
Kai: Mölder et al., Sustainable data analysis with Snakemake, F1000Research 10, 33 (2025).
4: T.
Kai: Šimko et al., REANA: A System for Reusable Research Data Analyses, EPJ Web Conf.
Paper summary: Kai: So to go deeper into that structure, Celebi separates things like the analysis definition—that's your code, configurations—from the actual data products generated during execution >
Mira: And it uses two main components: the Analysis Repository, which holds the evolving analysis definition, and a Production Factory which handles all the running and generates those results >
Lev: The paper says they use a middleware layer to connect these two parts so that preserved analysis states can actually be executed and their results get associated with the right definitions >
Kai: What’s really interesting for me is how it manages provenance, because instead of treating results like simple output files, it links them to immutable task impressions >
Mira: Those impressions identify the preserved code and configuration along with the exact impressions of all upstream dependencies that created that result >
Lev: That means even if you use the same algorithm and parameters, if one of your upstream inputs changes, it creates a totally distinct preserved analysis state >
Kai: So you can trace where every result came from through those dependency impressions, which is really useful when the analysis keeps evolving constantly >
Mira: And because results stay associated with those states even as the working analysis keeps changing, you can inspect and compare them later on >
Lev: That capability to compare retained results with their corresponding preserved states makes it much easier to spot differences in configuration or input changes, similar to how you'd do version control but for entire analysis definitions >
Kai: It’s about making the process of development and review more transparent by capturing that history during everyday analysis development >
Mira: So, the main point is that this framework provides a foundation for extending FAIR principles not just to raw research data, but to the computational analyses themselves >
Conclusion: Kai: Thinking about the title, "CELEBI," it sounds like a system for managing that complexity we talked about, keeping analysis materials organized >
Mira: And the authors are Mingrui Zhao and his team from Peking University, and they are presenting this as a way to make physics analysis development much more systematic >
Lev: What this means for the broader community is that instead of every person having to manually keep track of all those dependencies and historical configurations, there's a structured way to do it >
Kai: It gives researchers a practical way to handle modification, reuse, and collaboration without constantly rebuilding the entire analysis from scratch >
Mira: It moves the focus from just producing a single final result to managing the whole history of how you got there, which is really important for long-term preservation >
Lev: For people actually building real experiments or running complex simulations, it suggests a better way to handle the computational overhead because they can rely on these preserved states >
Kai: So ultimately, it’s about making those computational analyses more transparent and reusable by tying the output directly to the exact state that produced it >
Mingrui Zhao
School of Physics, State Key Laboratory of Nuclear Physics and Technology, Peking University
hep-ex
Submitted: 2026-11-01
Updated: 2026-11-01
Comments: 6 pages, 2 figures, ICHEP proceedings
License: http://creativecommons.org/licenses/by/4.0/
Importance score: 91/100
The gist: Celebi organizes reusable algorithms, tasks, and their dependencies into a structured workflow, preserves selected states as immutable impressions…
Key concepts
- Analysis Repository
- This component maintains the evolving definition of an analysis, including code, parameters, and documentation. It stores the lightweight materials that define what an analysis is made of. It acts as the central place for managing all parts of the analysis definition.
- Production Factory
- This component handles the execution phase where analyses are run and results are generated. It takes definitions from the Analysis Repository and produces large data products, separating them from the lightweight analysis definitions.
Terminology
Summary
Celebi organizes reusable algorithms, tasks, and their dependencies into a structured workflow, preserves selected states as immutable impressions, and associates retained results with the states responsible for their production The paper introduces Celebi as an analysis-management framework that maintains a persistent connection between evolving analysis materials and their generated results
System Architecture
Celebi separates potentially large data products generated during execution from the lightweight materials defining a physics analysis, including code, configurations, parameters, documentation, and dependencies Its two main components are the Analysis Repository, which maintains the evolving analysis definition, and the Production Factory, which handles execution and generated results The middleware layer Yuki connects the two, allowing preserved analysis states to be executed and their results to be associated with the corresponding analysis definitions
Analysis Organization
Changes to inputs, algorithms, or configurations may require several downstream computations to be updated or repeated Celebi simplifies the management of such changes by explicitly representing analysis components and their dependencies Each component records its own dependencies, removing the need for a single, centrally maintained workflow description The system distinguishes between editable working analysis and immutable impressions
Provenance Management
Results are associated with immutable task impressions rather than treating them as independent output files These impressions identify preserved code and configuration, including task parameters, together with the exact impressions of upstream dependencies This allows the provenance of a result to be traced through the analysis When results remain retained, they can be inspected and compared together with their respective preserved analysis states
Collaboration and Preservation
Celebi organizes analysis materials, documentation, and dependencies into structured repository objects Collaborators can inspect a selected component together with its local documentation and dependencies, without first reconstructing the complete analysis from unrelated files Immutable impressions also give collaborators and reviewers stable references to particular analysis states This organization facilitates analysis handover and long-term preservation
FAIR Principles Extension
By associating results with identifiable analysis states, Celebi provides a foundation for finding and reusing analysis materials and outputs Its structured representation supports programmatic interpretation and can facilitate interoperability with other infrastructures The separation of analysis definitions from generated data facilitates their independent preservation This contributes to more transparent and reusable physics analyses
Summary
Celebi simplifies the management of physics analyses throughout their lifecycle by organizing analysis components and their dependencies into a structured, modular representation Its modular organization and explicit dependencies make analysis components easier to modify, reuse, and reorganize Immutable impressions retain the link between generated results and the analysis states responsible for their production These capabilities support historical result inspection, collaboration, and review with less reliance on manual bookkeeping They also support systematic variations and controlled rerunning of preserved states provided that the required inputs, software environments, and execution infrastructure remain available Maintaining analysis states and provenance during everyday development also provides a natural starting point for long-term preservation In this way, Celebi offers a practical foundation for extending FAIR principles beyond research data to the computational analyses used to produce scientific results
REFERENCES
[3] F. Mölder et al. p. 4 1038/s41567-018-0342-2. Mölder et al. Mölder et al. , Sustainable data analysis with Snakemake, F1000Research 10, 33 (2025).Where the paper says it
Where the paper says it
[4] T. Šimko et al. p. 4 12688/f1000research. Šimko et al. Šimko et al. , REANA: A System for Reusable Research Data Analyses, EPJ Web Conf.Where the paper says it
Where the paper says it
[5] X. Chen et al. p. 4 1038/533452a. Chen et al. Chen et al. , CERN Analysis Preservation: A Novel Digital Library Service to Enable Reusable and Reproducible Research, Lect. , CERN Analysis Preservation: A Novel Digital Library Service to Enable Reusable and Reproducible Research, Lect. Notes Comput. Notes Comput. 9819, 347 (2016).Where the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
[6] M. Zhao, Celebi: Design and Realization of a Reproducible Physics Analysis Framework, CHEP conference proceedings, unpublished manuscript (2026). p. 4 1007/978-3-319-43997-6_27. Zhao, Celebi: Design and Realization of a Reproducible Physics Analysis Framework,
CHEP conference proceedings, unpublished manuscript (2026).Where the paper says it
--- Page 1 ---
Celebi: Towards Reproducible and FAIR Physics Analysis
Mingrui Zhao∗
School of Physics, State Key Laboratory of Nuclear Physics and Technology
Peking University, Beijing, China
Abstract
Modern physics analyses evolve continuously as datasets, selections, parameters, software environments, and analysis strategies are updated Over the lifetime of an analysis, this evolution can make it difficult to determine the conditions under which an earlier result was produced or to transfer the analysis reliably between collaborators I designed and developed Celebi as an analysis-management framework that maintains a persistent connection between evolving analysis materials and their generated results Celebi organizes reusable algorithms, tasks, and their dependencies into a structured workflow, preserves selected states as immutable impressions, and associates retained results with the states responsible for their production This organization supports analysis modification, systematic variations, collaboration, and review while the working analysis continues to evolve Celebi supports controlled rerunning of preserved analysis states When results remain retained, they can be inspected and compared together with their corresponding states By capturing provenance during everyday analysis development, Celebi reduces the need to reconstruct analysis history retrospectively and provides a practical foundation for more transparent and reusable physics analysis
--- Page 2 ---
Celebi addresses this challenge by organizing analysis materials into structured components and preserving selected analysis states Generated results remain associated with the states under which they were produced, even as the working analysis continues to evolve By separating lightweight analysis definitions from generated data products while retaining their relationships, Celebi facilitates analysis modification, algorithm reuse, systematic variations, and historical result management This paper focuses on the practical implications of Celebi for physics analysis development, collaboration, review, and preservation Its underlying workflow architecture, repository organization, and impression mechanism are described in a companion paper [6]
--- Page 3 ---
Celebi simplifies the management of evolving physics analyses by organizing analysis components and their dependencies into a structured, modular representation Analysts can modify, reuse, and reorganize components while retaining the relationships between preserved analysis configurations and their results Celebi simplifies the management of such changes by explicitly representing analysis components and their dependencies Each component records its own dependencies, removing the need for a single, centrally maintained workflow description Individual components can thus be modified without rewriting unrelated parts of the analysis Celebi also separates reusable algorithms from the tasks that apply them An algorithm defines a computational procedure, while a task specifies its application with particular parameters and upstream dependencies The same algorithm can be used by multiple tasks without duplicating its implementation Because components are represented as structured repository objects, they can be copied, reorganized, and modified through familiar file-system-like operations while retaining their dependency relationships Optimization studies and systematic variations can consequently share unchanged components while modifying only the parts that differ
--- Page 4 ---
In Celebi, results are associated with immutable task impressions rather than treating them as independent output files These impressions identify preserved code and configuration, including task parameters, together with the exact impressions of upstream dependencies This allows the provenance of a result to be traced through the analysis Even if a task uses the same algorithm and parameters, a change to an upstream input can produce a distinct preserved analysis state Recording the dependency impressions makes it possible to distinguish these configurations and keep their results associated with the appropriate states When results remain retained, they can be accessed and compared together with their respective preserved analysis states, making it easier to identify differences in their configurations This approach complements conventional source-code version control
--- Page 5 ---
Physics analyses often involve multiple collaborators and several rounds of internal review Effective collaboration requires a shared understanding of analysis structure, computational procedures, and the configurations used to produce results Celebi organizes analysis materials, documentation, and dependencies into structured repository objects Collaborators can inspect a selected component together with its local documentation and dependencies, without first reconstructing the complete analysis from unrelated files Immutable impressions also give collaborators and reviewers stable references to particular analysis states Reviewers can inspect the configuration associated with a result even after the working analysis has evolved When changes are introduced in response to review comments, updated states and results can be retained alongside those examined in earlier review rounds, facilitating comparisons between revisions The same organization facilitates analysis handover and long-term preservation
--- Page 6 ---
By capturing provenance during ordinary analysis development, Celebi reduces the need to reconstruct analysis history retrospectively when results are reviewed, transferred, or preserved Its structured components and accompanying documentation reduce reliance on individual conventions and personal knowledge when an analysis is transferred to new collaborators By capturing provenance during ordinary analysis development, Celebi reduces the need to reconstruct analysis history retrospectively when results are reviewed, transferred, or preserved In this way, Celebi offers a practical foundation for extending FAIR principles beyond research data to the computational analyses used to produce scientific results
--- Page 7 ---
Celebi simplifies the management of evolving physics analyses by organizing analysis components and their dependencies into a structured, modular representation Its modular organization and explicit dependencies make analysis components easier to modify, reuse, and reorganize
--- Page 7 ---
By capturing provenance during ordinary analysis development, Celebi reduces the need to reconstruct analysis history retrospectively when results are reviewed, transferred, or preserved
--- Page 7 ---
In this way, Celebi offers a practical foundation for extending FAIR principles beyond research data to the computational analyses used to produce scientific results
Green — the paper says it, and the page is printed. Red — no passage carries it, so treat that sentence as unverified. The same check runs on your own text: check a summary against its source, $5.
Improvements for AI systems
-
Improved analysis modification through modular organization: Analysts can modify, reuse, and reorganize components while retaining the relationships between preserved analysis configurations and their results. This allows optimization studies to share unchanged components while modifying only the parts that differ, which
reduces duplication and makes differences between configurations more explicit.
-
Enhanced provenance tracing via immutable impressions: Results are associated with immutable task impressions that
identify preserved code and configuration, including task parameters, together with the exact impressions of upstream dependencies.
This allows the provenance of a result to be traced through the analysis even after changes to an upstream input. -
Streamlined collaboration and review workflows: Collaborators can inspect a selected component together with its local documentation and dependencies without first reconstructing the complete analysis from unrelated files. Reviewers can
inspect the configuration associated with a result even after the working analysis has evolved,
facilitating comparisons between revisions by retaining updated states alongside earlier ones. -
Support for systematic variations and controlled rerunning: The system supports
controlled rerunning of preserved analysis states
provided thatthe required inputs, software environments, and execution infrastructure remain available.
This enables reproducibility under specific conditions beyond simple source code version control.
Abstract
Modern physics analyses evolve continuously as datasets, selections, parameters, software environments, and analysis strategies are updated. Over the lifetime of an analysis, this evolution can make it difficult to determine the conditions under which an earlier result was produced or to transfer the analysis reliably between collaborators. We present Celebi, an analysis-management framework that maintains a persistent connection between evolving analysis materials and their generated results. Celebi organizes reusable algorithms, tasks, and their dependencies into a structured workflow, preserves selected states as immutable impressions, and associates retained results with the states responsible for their production. This organization supports analysis modification, systematic variations, collaboration, and review while the working analysis continues to evolve. Celebi supports controlled rerunning of preserved analysis states. When results remain retained, they can be inspected and compared together with their corresponding states. By capturing provenance during everyday analysis development, Celebi reduces the need to reconstruct analysis history retrospectively and provides a practical foundation for more transparent and reusable physics analysis.
Related papers
- DrSai: an agentic AI system toward autonomous physics analysis workflows at BESIII
- CANTON- mu Proposal: A Next-Generation Muon g-2 Measurement at Sub-0.1 ppm Precision
- Search for dark photon dark matter near 1,meV using a superconducting mixer
- ANUBIS detector and its sensitivity to neutral long-lived particles
- How to scale your HEP ML models: A recipe for robust architecture comparisons at scale
- Search for the 16 O(ppp) to 13 C pi+ pi+ e+ Decay Mode in Super-Kamiokande Using Machine Learning Techniques