Silent coverage failures in rare-event searches and a degeneracy index that predicts them
summary
The gist
Searches for new physics in low-background experiments infer a non-negative signal strength from few events and often report an upper limit.
In short
The authors introduce a Poisson–Fisher degeneracy index, IPF = (β, γ), to diagnose silent coverage failures in rare-event searches. This index pairs a signed signal bias (β) with a residual mismatch norm (γ). It helps researchers screen potential model errors before calibration by indicating if the fitted signal shift threatens interval endpoints or if the residual can reveal the error.
Key concepts
- Poisson–Fisher degeneracy index IPF(δν; ϑ0)
- This index is a diagnostic tool that maps a specified expected-count deformation to two values: β and γ. It tells researchers whether a model error can bias the fitted signal, which interval endpoint is at risk, and if the residual mismatch can detect the error.
- Signed fitted signal shift (β)
- This coordinate represents the predicted shift in µ, expressed in profiled standard-error units. It measures how much a model deformation could potentially damage the inferential results of a search by biasing the fitted signal.
- Poisson–Fisher norm of the residual (γ)
- This non-negative coordinate is the Poisson–Fisher norm of the residual left outside all fitted directions. It quantifies how much mismatch exists between the model and data, indicating if a compatible residual-based goodness-of-fit test can be performed.
- Controlled model misspecification
- This involves intentionally deforming the nominal expected-count vector ν⋆(ϑ; s) by adding a perturbation δν. This covers various errors like unmodelled background tails, shifted dark-matter halos, or overestimated signal efficiency.
Terminology used across episodes
This episode discusses
- Silent coverage failures in rare-event searches and a degeneracy index that predicts them · Paper Radio
- First Dark Matter Search with Nuclear Recoils from the XENONnT Experiment
- Results from the Super Cryogenic Dark Matter Search (SuperCDMS) experiment at Soudan
- Final Results of GERDA on the Search for Neutrinoless Double- beta Decay
- Search for Majorana neutrinos exploiting millikelvin cryogenics with CUORE
- Search for the Majorana Nature of Neutrinos in the Inverted Mass Ordering Region with KamLAND-Zen
- Asymptotic formulae for likelihood-based tests of new physics
- A Unified Approach to the Classical Statistical Analysis of Small Signals
- Confidence Level Computation for Combining Searches with Small Statistics
- The frontier of simulation-based inference
- Likelihood-Free Frequentist Inference: Bridging Classical Statistics and Machine Learning for Reliable Simulator-Based Inference
- A Trust Crisis In Simulation-Based Inference? Your Posterior Approximations Can Be Unfaithful
- Investigating the Impact of Model Misspecification in Neural Simulation-based Inference
- Conformal Prediction Under Covariate Shift
- Conformal prediction beyond exchangeability
- Astrophysical uncertainties on the local dark matter distribution and direct detection experiments
- Measurement of Higgs boson production in the diphoton decay channel in pp collisions at center-of-mass energies of 7 and 8 TeV with the ATLAS detector
- Observation of the diphoton decay of the Higgs boson and measurement of its properties
The paper
Silent coverage failures in rare-event searches and a degeneracy index that predicts them · Read on arXiv
Department of Mechanical and Industrial Engineering, University of Brescia · Istituto Nazionale di Fisica Nucleare
Searches for new physics in low-background experiments infer a non-negative signal strength from few events and often report an upper limit. Nominal frequentist coverage requires both a valid interval construction and an adequate data model. We study how controlled model departures affect lower- and upper-endpoint coverage for six interval procedures in an exact Poisson counting experiment, dark-matter recoil spectra, and a neutrinoless-double-beta-decay peak search. We introduce the Poisson--Fisher degeneracy index I PF(δν; 0)=(β,γ), which maps a specified expected-count deformation, after projection onto the complete fitted tangent space, to β, the signed fitted signal shift in profiled standard-error units, and γ, the Poisson--Fisher norm of the unabsorbed residual. Locally, the sign of β identifies the threatened endpoint, while larger γ implies greater detectability by the saturated-Poisson goodness-of-fit test used here at a fixed 5% type-I error rate. Across the studied deformations, positive signal-like bias degrades discovery-side coverage while making upper limits conservative; negative signal bias from overestimated signal efficiency can make the upper endpoint undercover. Calibration under the nominal simulator does not protect against misspecification of that simulator relative to the data-generating process. A plausible deformation with large β and small γ may therefore evade diagnosis and should be represented by a nuisance constrained with auxiliary information or included in a defensible envelope. In the exactly collinear constrained-nuisance benchmark, modelling the deformation restores coverage at the evaluated grid points, at a quantifiable cost in interval sensitivity.
DOI: 10.1140/epjc/s10052-026-16570-7
Transcript
Introduction to the show: ident: High Energy Physics: Experiment. The day in high-energy experiment: detectors, searches and limits.
Kai: We're looking at the paper: "Silent coverage failures in rare-event searches and a degeneracy index that predicts them".
Mira: Here's the gist of the paper. Searches for new physics in low-background experiments infer a non-negative signal strength from few events and often report an upper limit.
Kai: The Poisson–Fisher degeneracy index IPF(δν; ϑ0) = (β, γ), which maps a specified expected-count deformation, after projection onto the complete fitted tangent space, to β, the signed fitted signal shift in profiled standard-error units, and γ, the Poisson–Fisher norm of the unabsorbed residual.
Mira: This index provides a local diagnostic for whether a physically specified model error can bias the fitted signal, which interval endpoint is threatened, and whether the fitted residual can reveal the error.
Kai: Pruning redundant reasoning tokens The paper introduces the Poisson–Fisher degeneracy index IPF = (β, γ), which pairs the signed standardized signal bias with the residual left outside the complete fitted tangent space.
Paper summary: Kai: So, to wrap up the paper, "Silent coverage failures in rare-event searches and a degeneracy index that predicts them," it’s about giving us this Poisson–Fisher degeneracy index, which maps model deformation to signal shift and residual mismatch.
Mira: The authors are showing how this index lets us screen potential coverage damage and goodness of fit detectability before we even start toy calibrations using just expected bin counts and local model derivatives.
Lev: Essentially, they’re giving researchers a way to diagnose whether a plausible model error can bias the fitted signal, which interval endpoint is threatened, and if the fitted residual can reveal that error.
Kai: The implication is that this index provides a local diagnostic for coverage failure in rare-event searches where we infer a non-negative signal strength from few events and often report an upper limit.
Mira: It helps us understand the tension between the interval construction and the data model, especially when regularity conditions underpinning standard asymptotic theory fail, like with low counts or nuisance parameters.
Lev: The title points to the fact that these failures can be silent—meaning the interval misses its frequentist target while our goodness of fit test still seems okay.
Kai: It’s a useful framework for guiding model checks and uncertainty treatment in experiments where we’re pushing low-background limits using few events, like in dark matter recoil spectra.
Conclusion: Kai: So, this paper introduces something called a Poisson Fisher degeneracy index that pairs how much the model is wrong with how much the signal prediction gets skewed and what’s left over in our residual.
Mira: It sounds like they're giving us a diagnostic tool to see if our model assumptions are messing up our final measurement when we only have a few events.
Lev: From an engineering side, that means before we spend time calibrating everything with toy numbers, we can check if the model itself is introducing bias or if the residual will even show us the error.
Kai: Exactly. The authors are showing this index helps screen potential coverage damage and goodness of fit issues before we even start our calibration work using just expected counts.
Mira: It’s about identifying those tricky situations where a plausible error in our model could hide a problem or make us think our interval is covering the right thing when it's not.
Lev: And they show how to use the sign of that index, that beta value, to tell if a positive bias threatens the lower endpoint or if a negative bias makes the upper endpoint undercover.
Kai: That’s really useful for understanding why some searches might fail and others might seem okay just because of how we framed our analysis.
Mira: It moves us away from just checking if the numbers fit, toward actually checking if the underlying physics model is compatible with what we're observing.
Lev: It’s a way to prioritize where we need to spend our time fixing things—is it a nuisance parameter that needs constraining, or is it a fundamental issue with how we modeled the signal itself?
Kai: And they show that this index isn't universal across all types of model errors, which is important because it tells us what kind of problem we’re likely dealing with.
Mira: It sets up a new way to think about uncertainty—not just as a single number on an axis, but as a relationship between the signal shift and the residual mismatch.
Lev: It gives us a way to guide those model checks when we're pushing the limits of what we can measure with low event statistics.
Kai: So it’s not just about finding new physics, it’s about making sure our search methodology is sound before we declare something found, or that we miss something important.
Mira: It really shifts the focus onto the connection between our theoretical model and the practical limits of what a detector can actually measure.
More episodes
- Daily Summary for 2026-11-19
- 2512.21290-Model-independent ZH production cross section at FCC-ee
- 2610.21982-First Observation of the Radiative Decay D 0 to gamma omega
- The day in conversation for 2026-11-19
- Daily Summary for 2026-11-19
- Daily Summary for 2026-11-18
- 2512.08065-Searches for Light Dark Matter and Evidence of Coherent Elastic Neutrino-Nucleus Scattering of Solar Neutrinos with the LUX-ZEPLIN (LZ) Experiment
- Daily Summary for 2026-11-18
- 2508.18022-Precision Measurements of the Electroweak Mixing Angle in the Region of the Z pole at the Large Hadron Collider
- 2512.23992-Prospect for measurement of CP-violating parameters of B s 0 to phi gamma at the Tera Z factory