Correlated Systematic Uncertainties and Errors-on-Errors in Measurement Combinations: Methodology and Application to the 7-8 TeV ATLAS-CMS Top Quark Mass Combination
summary
The gist
The Gamma Variance Model (GVM) provides a statistical framework to handle uncertainties in systematic errors—informally called errors-on-errors—which is particularly useful when combining results…
In short
The Gamma Variance Model (GVM) is a statistical method to handle uncertainties in systematic errors when combining measurements, like the ATLAS-CMS top quark mass. It treats 'errors-on-errors' as random variables, allowing for more realistic error modeling. The study shows the combination's central value is robust, but confidence intervals widen when input data consistency drops.
Key concepts
- Gamma Variance Model (GVM)
- A statistical framework that models uncertainties in systematic errors by treating the systematic variance as a random variable following a gamma distribution. This allows researchers to account for 'errors-on-errors,' which are uncertainties in how systematic errors themselves are assigned, rather than just fixed values.
- Best Linear Unbiased Estimator (BLUE) vs. Nuisance Parameter Method
- The paper establishes a general link between two methods for estimating results when systematic uncertainties are correlated. It shows how to extend the nuisance parameter method to include errors-on-errors, providing analytical formulas for calculating central values and confidence intervals under complex correlation conditions.
- Errors-on-Errors
- These are uncertainties arising from errors in assigning systematic error values, often related to ambiguities in defining a '1-sigma' error or estimation procedures. The GVM specifically models these as random variables, allowing the analysis to account for how uncertainty in the error assignment affects the final result.
- Robustness and Outlier Sensitivity
- The GVM demonstrates that while the central value of a measurement combination is stable against uncertain systematic errors, its confidence interval size is sensitive to internal data consistency. When an outlier is added, its influence on the combination decreases as the error-on-error parameter increases.
Terminology used across episodes
This episode discusses
- Correlated Systematic Uncertainties and Errors-on-Errors in Measurement Combinations: Methodology and Application to the 7-8 TeV ATLAS-CMS Top Quark Mass Combination · Paper Radio
- Combination of measurements of the top quark mass from data collected by the ATLAS and CMS experiments at sqrt s = 7 and 8 TeV
- Combination of CDF and D0 results on the mass of the top quark using up to 9.7 fb-1 at the Tevatron
- A study of systematic uncertainties within the MSHT PDF Framework
The paper
Correlated Systematic Uncertainties and Errors-on-Errors in Measurement Combinations: Methodology and Application to the 7-8 TeV ATLAS-CMS Top Quark Mass Combination · Read on arXiv
Enzo Canonero, Glen Cowan
Royal Holloway, University of London
The Gamma Variance Model (GVM) is a statistical model that incorporates uncertainties in the assignment of systematic errors (informally called errors-on-errors). The model is of particular use in analyses that combine the results of several measurements. In the past, combinations have been carried out using two alternative approaches: the Best Linear Unbiased Estimator (BLUE) method or what we will call the nuisance-parameter method. In this paper we derive useful relations that allow one to connect the BLUE and nuisance-parameter methods when the correlations induced by systematic uncertainties are non-trivial (1, -1 or 0), and we generalise the nuisance-parameter approach to include errors-on-errors. We then illustrate some of the properties of the GVM by applying it to the 7-8 TeV ATLAS-CMS top quark mass combination. We present results by considering the largest systematic uncertainties as uncertain, one at a time, and we vary their associated error-on-error parameters. This procedure is useful for identifying the systematic uncertainties to which a combination is sensitive when they are themselves uncertain. We also explore the hypothetical scenario of including an outlier in the combination, which could become relevant for future combinations, by artificially adding a fictitious measurement to it. This example highlights a key feature of the GVM: its sensitivity to the internal consistency of the input data.
DOI: 10.1140/epjc/s10052-025-13884-w
Transcript
Introduction to the show: ident: High Energy Physics: Experiment. The day in high-energy experiment: detectors, searches and limits.
Kai: We're looking at the paper: "Correlated Systematic Uncertainties and Errors-on-Errors in Measurement Combinations".
Mira: Here's the gist of the paper. The Gamma Variance Model (GVM) provides a statistical framework to handle uncertainties in systematic errors—informally called errors-on-errors—which is particularly useful when combining results from several measurements, such as the 7–8 TeV ATLAS-CMS top quark mass combination.
Kai: The paper introduces the Gamma Variance Model (GVM) as a statistical model incorporating uncertainties in the assignment of systematic errors.
Mira: This model allows for the treatment of both types of errors-on-errors, including those arising from ambiguities in defining a "1-sigma" error and those stemming from the estimation procedures themselves.
Kai: The GVM extends the likelihood function by treating the systematic variance as an adjustable parameter, denoted as vs, which is modeled as a gamma-distributed random variable.
Title and authors: Kai: So we're looking at this paper today, "Correlated Systematic Uncertainties and Errors-on-Errors in Measurement Combinations: Methodology and Application to the seven-eight TeV ATLAS-CMS Top Quark Mass Combination" <ref:2407.05322#pg1,Application to the 7-8 TeV ATLAS-CMS Top Quark Mass Combination>. Mira, what's the main story here?
Mira: It’s essentially about how we handle those tricky errors that aren't just simple plus or minus one. It tackles how we combine measurements when those systematic uncertainties are actually correlated in a more complicated way.
Lev: So if I had to put it simply, the paper is building a statistical framework, the Gamma Variance Model, to deal with uncertainties in assigning those systematic errors.
Kai: Right, so it’s about making sure that when we combine results from different places—like ATLAS and CMS—we don't just treat all those systematic errors as perfectly known constants.
Mira: Exactly. It introduces this model where the variance itself becomes a random variable, modeled as a gamma distribution, which lets us adjust how much we trust each systematic assignment.
The paper's summary: Kai: So what does the paper actually do? It sets up this Gamma Variance Model to treat those errors-on-errors, which are the uncertainties in error estimation itself.
Mira: They show a general relationship between two ways of doing things—the Best Linear Unbiased Estimator method and what they call the nuisance-parameter method.
Lev: And they generalize that nuisance-parameter approach so it can handle these errors-on-errors, which is crucial because standard methods often get stuck when correlations are non-trivial.
Kai: They then derive analytical formulas for figuring out the central values of things, the confidence intervals, and even the goodness-of-fit under these new conditions.
Mira: The application they use is to this specific seven–eight TeV ATLAS-CMS top quark mass combination, looking at how those uncertain systematics affect the final result <ref:2407.05322#pg1,7–8 TeV ATLAS-CMS top quark mass combination>.
Lev: And they find something interesting about that combination: it shows that the central value is pretty robust to having those systematic errors be uncertain one at a time.
The paper's improvements: Kai: So what are the specific improvements they suggest over how we usually do these kinds of combinations?
Mira: The big improvement is incorporating those errors-on-errors directly into the model, which allows the central value to become less sensitive to discrepancies between different input data values.
Lev: They also show that when you add a fictitious outlier measurement, within the Gamma Variance Model framework, that outlier gets assigned lesser weight as the error-on-error parameter increases.
Kai: That means if we have a weird data point, it doesn't totally wreck our result; it just gets down-weighted based on how uncertain we are about our own error assignments.
Mira: And they also show that the size of the confidence interval itself becomes sensitive to the internal consistency of your input data, meaning it inflates when measurements don't line up perfectly.
Conclusion: Kai: So wrapping this up, what's the main point about this work on "Correlated Systematic Uncertainties and Errors-on-Errors in Measurement Combinations: Methodology and Application to the seven-eight TeV ATLAS-CMS Top Quark Mass Combination" <ref:2407.05322#pg1,Application to the 7-8 TeV ATLAS-CMS Top Quark Mass Combination>?
Mira: The core message is that for combinations like this top quark mass combination, treating those systematic uncertainties as having errors within their errors makes the central value very stable.
Lev: It’s about quantifying how much uncertainty comes from the input data not being fully compatible, which we see reflected in a larger confidence interval when those discrepancies are present.
Kai: So essentially, this framework is a general procedure for figuring out which systematic uncertainties you actually need to worry about when they have associated errors-on-errors.
Mira: The study concludes that the ATLAS-CMS mt combination is robust against these types of uncertainties, and it’s a useful tool for future combinations where those correlations are non-trivial.
Lev: For me, it shows us how to model the overhead of running this on real hardware because we can see how much uncertainty is added by these complex error structures.
Kai: That covers what we have here. We'll keep an eye on how this Gamma Variance Model helps us build better measurements for the next generation of experiments.
More episodes
- Daily Summary for 2026-11-19
- 2512.21290-Model-independent ZH production cross section at FCC-ee
- 2610.21982-First Observation of the Radiative Decay D 0 to gamma omega
- The day in conversation for 2026-11-19
- Daily Summary for 2026-11-19
- Daily Summary for 2026-11-18
- 2512.08065-Searches for Light Dark Matter and Evidence of Coherent Elastic Neutrino-Nucleus Scattering of Solar Neutrinos with the LUX-ZEPLIN (LZ) Experiment
- Daily Summary for 2026-11-18
- 2508.18022-Precision Measurements of the Electroweak Mixing Angle in the Region of the Z pole at the Large Hadron Collider
- 2512.23992-Prospect for measurement of CP-violating parameters of B s 0 to phi gamma at the Tera Z factory