CELEBI: Towards Reproducible and FAIR Physics Analysis
summary
The gist
Celebi organizes reusable algorithms, tasks, and their dependencies into a structured workflow, preserves selected states as immutable impressions…
In short
Celebi is an analysis management framework designed to handle evolving physics analyses by structuring components and dependencies into a modular workflow. It preserves selected states as immutable impressions, linking generated results directly to the specific analysis configurations that produced them. This enables easier modification, collaboration, and long-term preservation of scientific results.
Key concepts
- Analysis Repository
- This component maintains the evolving definition of an analysis, including code, parameters, and documentation. It stores the lightweight materials that define what an analysis is made of. It acts as the central place for managing all parts of the analysis definition.
- Production Factory
- This component handles the execution phase where analyses are run and results are generated. It takes definitions from the Analysis Repository and produces large data products, separating them from the lightweight analysis definitions.
Terminology used across episodes
This episode discusses
The paper
CELEBI: Towards Reproducible and FAIR Physics Analysis · Read on arXiv
Mingrui Zhao
School of Physics, State Key Laboratory of Nuclear Physics and Technology, Peking University
Modern physics analyses evolve continuously as datasets, selections, parameters, software environments, and analysis strategies are updated. Over the lifetime of an analysis, this evolution can make it difficult to determine the conditions under which an earlier result was produced or to transfer the analysis reliably between collaborators. We present Celebi, an analysis-management framework that maintains a persistent connection between evolving analysis materials and their generated results. Celebi organizes reusable algorithms, tasks, and their dependencies into a structured workflow, preserves selected states as immutable impressions, and associates retained results with the states responsible for their production. This organization supports analysis modification, systematic variations, collaboration, and review while the working analysis continues to evolve. Celebi supports controlled rerunning of preserved analysis states. When results remain retained, they can be inspected and compared together with their corresponding states. By capturing provenance during everyday analysis development, Celebi reduces the need to reconstruct analysis history retrospectively and provides a practical foundation for more transparent and reusable physics analysis.
Transcript
Introduction to the show: ident: High Energy Physics: Experiment. The day in high-energy experiment: detectors, searches and limits.
Kai: We're looking at the paper: "CELEBI: Towards Reproducible and FAIR Physics Analysis".
Mira: Here's the gist of the paper. Celebi organizes reusable algorithms, tasks, and their dependencies into a structured workflow, preserves selected states as immutable impressions, and associates retained results with the states responsible for their production The paper introduces Celebi as an analysis-management framework that maintains a persistent connection between evolving analysis materials and their generated results System Architecture Celebi separates potentially large data products generated during execution from the lightweight materials defining a physics analysis, including code, configurations, parameters, documentation, and dependencies Its two main components are the Analysis Repository, which maintains the evolving analysis definition, and the Production Factory, which handles execution and generated results The middleware layer Yuki connects the two, allowing preserved analysis states to be executed and their results to be associated with the corresponding analysis definitions Analysis Organization Changes to inputs, algorithms, or configurations may require several downstream computations to be updated or repeated Celebi simplifies the management of such changes by explicitly representing analysis components and their dependencies Each component records its own dependencies, removing the need for a single, centrally maintained workflow description The system distinguishes between editable working analysis and immutable impressions Provenance Management Results are associated with immutable task impressions rather than treating them as independent output files These impressions identify preserved code and configuration, including task parameters, together with the exact impressions of upstream dependencies This allows the provenance of a result to be traced through the analysis When results remain retained, they can be inspected and compared together with their respective preserved analysis states Collaboration and Preservation Celebi organizes analysis materials, documentation, and dependencies into structured repository objects Collaborators can inspect a selected component together with its local documentation and dependencies, without first reconstructing the complete analysis from unrelated files Immutable impressions also give collaborators and reviewers stable references to particular analysis states This organization facilitates analysis handover and long-term preservation FAIR Principles Extension By associating results with identifiable analysis states, Celebi provides a foundation for finding and reusing analysis materials and outputs Its structured representation supports programmatic interpretation and can facilitate interoperability with other infrastructures The separation of analysis definitions from generated data facilitates their independent preservation This contributes to more transparent and reusable physics analyses Celebi simplifies the management of physics analyses throughout their lifecycle by organizing analysis components and their dependencies into a structured, modular representation Its modular organization and explicit dependencies make analysis components easier to modify, reuse, and reorganize Immutable impressions retain the link between generated results and the analysis states responsible for their production These capabilities support historical result inspection, collaboration, and review with less reliance on manual bookkeeping They also support systematic variations and controlled rerunning of preserved states provided that the required inputs, software environments, and execution infrastructure remain available Maintaining analysis states and provenance during everyday development also provides a natural starting point for long-term preservation In this way, Celebi offers a practical foundation for extending FAIR principles beyond research data to the computational analyses used to produce scientific results REFERENCES
3: F.
Kai: Mölder et al., Sustainable data analysis with Snakemake, F1000Research 10, 33 (2025).
4: T.
Kai: Šimko et al., REANA: A System for Reusable Research Data Analyses, EPJ Web Conf.
Paper summary: Kai: So to go deeper into that structure, Celebi separates things like the analysis definition—that's your code, configurations—from the actual data products generated during execution >
Mira: And it uses two main components: the Analysis Repository, which holds the evolving analysis definition, and a Production Factory which handles all the running and generates those results >
Lev: The paper says they use a middleware layer to connect these two parts so that preserved analysis states can actually be executed and their results get associated with the right definitions >
Kai: What’s really interesting for me is how it manages provenance, because instead of treating results like simple output files, it links them to immutable task impressions >
Mira: Those impressions identify the preserved code and configuration along with the exact impressions of all upstream dependencies that created that result >
Lev: That means even if you use the same algorithm and parameters, if one of your upstream inputs changes, it creates a totally distinct preserved analysis state >
Kai: So you can trace where every result came from through those dependency impressions, which is really useful when the analysis keeps evolving constantly >
Mira: And because results stay associated with those states even as the working analysis keeps changing, you can inspect and compare them later on >
Lev: That capability to compare retained results with their corresponding preserved states makes it much easier to spot differences in configuration or input changes, similar to how you'd do version control but for entire analysis definitions >
Kai: It’s about making the process of development and review more transparent by capturing that history during everyday analysis development >
Mira: So, the main point is that this framework provides a foundation for extending FAIR principles not just to raw research data, but to the computational analyses themselves >
Conclusion: Kai: Thinking about the title, "CELEBI," it sounds like a system for managing that complexity we talked about, keeping analysis materials organized >
Mira: And the authors are Mingrui Zhao and his team from Peking University, and they are presenting this as a way to make physics analysis development much more systematic >
Lev: What this means for the broader community is that instead of every person having to manually keep track of all those dependencies and historical configurations, there's a structured way to do it >
Kai: It gives researchers a practical way to handle modification, reuse, and collaboration without constantly rebuilding the entire analysis from scratch >
Mira: It moves the focus from just producing a single final result to managing the whole history of how you got there, which is really important for long-term preservation >
Lev: For people actually building real experiments or running complex simulations, it suggests a better way to handle the computational overhead because they can rely on these preserved states >
Kai: So ultimately, it’s about making those computational analyses more transparent and reusable by tying the output directly to the exact state that produced it >
More episodes
- Daily Summary for 2026-11-19
- 2512.21290-Model-independent ZH production cross section at FCC-ee
- 2610.21982-First Observation of the Radiative Decay D 0 to gamma omega
- The day in conversation for 2026-11-19
- Daily Summary for 2026-11-19
- Daily Summary for 2026-11-18
- 2512.08065-Searches for Light Dark Matter and Evidence of Coherent Elastic Neutrino-Nucleus Scattering of Solar Neutrinos with the LUX-ZEPLIN (LZ) Experiment
- Daily Summary for 2026-11-18
- 2508.18022-Precision Measurements of the Electroweak Mixing Angle in the Region of the Z pole at the Large Hadron Collider
- 2512.23992-Prospect for measurement of CP-violating parameters of B s 0 to phi gamma at the Tera Z factory