Identifiability and partial identification under spatial confounding in additive risk models
Listen
Radio episode about this paper
Transcript
Introduction to the show: ident: Statistics. The day in statistics: methods, theory and the inference under them.
Tom: We're looking at the paper: "Identifiability and partial identification under spatial confounding in additive risk models".
Jane: Here's the gist of the paper. In spatial risk attribution, continuous environmental exposures and unmeasured background factors often co-vary across broad geographic scales, making it difficult to separate true exposure effects from spatial confounding using finite disease counts By decomposing the Fisher-weighted smoothing operator of an additive Poisson point process model, the authors show that while effective degrees of freedom measure total smoothing capacity, the relative loss of Fisher information for the exposure coefficient is governed solely by a distinct directional quantity called penalized collinear overlap Because real-world confounding combines smooth regional trends with sharp local jumps that escape any moderate basis dictionary, point identification remains fragile Problem Setup and Model Formulation The study uses an inhomogeneous Poisson point process over continuous space to model disease counts aggregated over administrative units The true unit-level additive risk vector is defined as the sum of known covariates, exposure effects, and an unobserved spatial latent field This latent field captures background confounding risk which inevitably overlaps with exposure over smooth spatial scales The working model approximates this unknown background field using a spatial kernel basis expansion with a quadratic roughness penalty Spectral Decomposition of Latent Field Flexibility The authors derive two distinct summary measures of latent field flexibility: the effective degrees of freedom EDF(λ) and the penalized collinear overlap ηpen(λ) EDF(λ) sums the shrinkage factors across all basis directions, measuring total fitting capacity regardless of where the exposure vector points By contrast, ηpen(λ) weights those shrinkage factors by the exposure energy shares pj(xW), measuring what fraction of exposure variation itself gets absorbed by the smoother Proposition 1 shows that this directional overlap, rather than total capacity, governs the effective information left for estimating β Benchmark Partial Identification Framework To address unmeasured confounding with unknown spatial structures, the authors develop a design-stage orthogonalization and partial identification method using an observable benchmark variable V This method measures how much bias a representative background factor removes by comparing estimates before and after adding the benchmark variable The resulting population interval is bounded by the true effect β in the set ΘΓ =
θa −Γd0, θa +Γd0: Negative Control Calibration and Diagnostics The authors introduce a negative control outcome YNC to trim away parts of the symmetric benchmark interval with the wrong bias sign Combining the benchmark variable with the negative control outcome in a three-dimensional confidence ellipsoid narrows the interval and flags cases where sources of evidence conflict The pre-reporting check event Gn is defined by three simple ratios that must hold for reporting valid results Empirical Study and Conclusions The empirical study on childhood respiratory mortality across England demonstrates that the multi-scale dictionary retains medium-scale variation with essentially the same spatial HAC variance as the 10 km specification The positivity of the NO2 effect therefore survives partial identification under a substantial departure from the calibrated benchmark The authors conclude that combining a multi-scale dictionary with an observable benchmark variable and a negative control outcome yields valid partial identification intervals Cn(Γ) and C NC n across transparent sensitivity bounds References BEST, N.
Tom: G., ICKSTADT, K.
Jane: & WOLPERT, R.
Tom: L.
Paper summary: Tom: So we're looking at this paper, "Identifiability and partial identification under spatial confounding in additive risk models," and the main idea is that when you try to figure out if a certain exposure actually causes an effect, it gets really messy because those continuous environmental exposures and unmeasured background factors often move together over large areas.
Jane: That sounds frustrating for anyone trying to get a clear picture of risk attribution, right? So what does this paper actually claim about how hard it is to separate the true exposure effect from all that spatial confounding using just finite disease counts?
Tom: Well, the authors look at how they decompose the Fisher-weighted smoothing operator from an additive Poisson point process model and show that while total smoothing capacity, called effective degrees of freedom, measures the overall fitting power of a spatial basis expansion, it's not actually that what matters for estimating your exposure coefficient.
Lu: That’s interesting because it suggests that just having more capacity isn't the only thing determining how much information you keep about the exposure itself; there’s something more specific happening directionally.
Meng: So this is saying that even if you have a huge set of basis functions, the actual loss of information for your exposure estimate depends on how those functions align with the actual pattern of your exposure.
Lalam: Exactly, and they call this directional quantity penalized collinear overlap; it’s not just about total smoothing ability.
Tom: Right, so the paper argues that this penalised collinear overlap is the key thing governing what information is left for estimating your exposure coefficient, rather than just the effective degrees of freedom of the basis space.
Jane: That’s a really specific concept they introduce, and it sounds like it might explain why some estimation methods are unstable even when you have a lot of data.
Lu: It implies that no single smoothing scale can maximize your effective information across all possible exposure patterns; different scales lose information at different rates depending on the pattern.
Meng: If two different spatial bases have the exact same total capacity, but one aligns better with the dominant spatial pattern of your exposure, that other basis will suffer a much bigger drop in effective information.
Tom: That’s a really clear illustration of why choosing the right setup matters; it's not just about picking the biggest dictionary you can find.
Jane: And they tie this into a benchmark partial identification framework where you use an observable variable, V, to measure how much bias a representative background factor removes by comparing estimates before and after adding that variable.
Lu: That benchmark method creates an interval bounded by the true effect beta in the set theta gamma, which is essentially your range of possible true effects under certain conditions.
Meng: So you’re not just looking for a single point estimate, but you’re getting a whole range based on how well that specific benchmark variable works against the background noise.
Tom: And then they introduce this negative control outcome, YNC, which is used to trim away parts of that symmetric interval that have the wrong bias sign when combining it with the benchmark variable in a three-dimensional confidence ellipsoid.
Jane: That sounds like a sophisticated way to narrow down those uncertainty intervals and flag when your different sources of evidence are actually conflicting with each other.
Lu: The pre-reporting check event Gn is defined by three simple ratios that have to hold for reporting valid results, which acts as a diagnostic tool before you even publish your findings.
Meng: From a production standpoint, having these checks means you don't ship models that might be based on assumptions that the data doesn't support when things get weird at scale.
Tom: The empirical study they ran on childhood respiratory mortality across England showed that the multi-scale dictionary retained medium-scale variation with essentially the same spatial heat variance as a ten kilometer specification.
Jane: That’s a pretty strong finding, suggesting that even with multiple scales, you still have some robustness when you look at those medium scales.
Lu: The positivity of the NO2 effect actually survived partial identification under a substantial departure from that calibrated benchmark; it means the effect holds up even when things aren't perfectly tuned to the assumed background structure.
Meng: That’s reassuring because it shows that you don't need everything to be perfectly aligned with your initial assumptions for your result to stay valid.
Tom: So, in short, this paper suggests that combining a multi-scale dictionary with an observable benchmark variable and a negative control outcome yields valid partial identification intervals, Cn gamma and C NC n across transparent sensitivity bounds.
Jane: It sounds like the whole point is moving past just trying to project out or penalize shared spatial trends by focusing on this directional overlap measure called penalized collinear overlap instead.
Lu: Yeah, the main implication here is that you need a different way to think about what causes estimation instability; it’s not just about how much smoothing you use, but how those smoothers interact with the specific pattern of your exposure.
Tom: And for someone who only listens to this show, it means that when you're trying to figure out if an environmental factor is causing a health issue, you need to look at the alignment between your model and that factor’s spatial structure, not just how complex your model is.
Conclusion: Tom: So we're wrapping up our look at this paper, "Identifiability and partial identification under spatial confounding in additive risk models." Basically, they're showing how to get a real handle on causal effects when you have all that messy, overlapping background stuff in your data.
Jane: Right. The authors are trying to figure out if we can actually separate the true exposure effect from the noise created by those unmeasured spatial trends. What they’ve done is use these clever mathematical tools to create a way to get a valid range of possible effects instead of just one guess.
Lu: They focus on this concept called penalized collinear overlap, which is different from just measuring how much total smoothing power you have across all your model options. It tells you which spatial patterns your exposure actually aligns with the most.
Meng: So they're saying that the way you smooth things matters directionally, not just by how many basis functions you throw at it. That makes sense for production, because if we pick a basis that matches the real underlying structure, we should get better estimates.
Lalam: I'm confident in this finding because it’s based on decomposing the mathematical operator of the model itself. It’s not just an assumption; it comes from analyzing how the data is structured over space.
Tom: What does this actually change for us when we're building risk models? If we can identify this overlap, we might be able to build systems that are much more robust against those hidden spatial confounders.
Jane: It means that even with complex environmental exposures, we aren't just guessing the effect; there’s a specific mathematical way to constrain our uncertainty around that guess. It moves us closer to knowing what the real risk is.
Lu: The paper shows that by combining this directional overlap concept with an observable benchmark variable and a negative control outcome, you can actually produce these partial identification intervals, which are much tighter than what we get from simpler methods.
Meng: Tighter intervals mean fewer false alarms in our models when we deploy them. If the interval is narrow enough, we know for sure that the effect is real and not just noise from a random spatial jump.
Tom: It sounds like they’ve built a really solid diagnostic check right into the math, which is exactly what you need when you're shipping models to production where things can go sideways.
Jane: Exactly. So, this work gives us a concrete method for moving from just saying "this might be the cause" to actually saying "this is the effect, and here is how certain we are about it." Next up, we'll look at how they put this into practice on real data sets.
Sheng Pan
Yunnan Key Laboratory of Statistical Modeling and Data Analysis, Yunnan University
stat.ME
Submitted: 2026-11-12
Updated: 2026-11-12
License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
Importance score: 90/100
The gist: In spatial risk attribution, continuous environmental exposures and unmeasured background factors often co-vary across broad geographic scales…
Key concepts
- Additive Poisson Point Process Model
- This model is used to describe disease counts aggregated over continuous space. It assumes that the total risk at any point is a sum of known factors, exposure effects, and an unobserved background spatial field that varies across the area.
- Effective Degrees of Freedom (EDF)
- EDF measures the total smoothing capacity of a spatial basis expansion. It tells you how much flexibility the model has in fitting data regardless of where your exposure vector points. It represents the overall ability to smooth out spatial variation.
- Penalized Collinear Overlap ($\eta_{pen}(\lambda)$)
- This directional quantity measures what fraction of the exposure's variation is absorbed by the smoother. It shows how much of the information about your specific exposure coefficient is lost due to overlapping with smooth regional trends, which depends on the alignment between your model basis and those trends.
Terminology
Summary
In spatial risk attribution, continuous environmental exposures and unmeasured background factors often co-vary across broad geographic scales, making it difficult to separate true exposure effects from spatial confounding using finite disease counts By decomposing the Fisher-weighted smoothing operator of an additive Poisson point process model, the authors show that while effective degrees of freedom measure total smoothing capacity, the relative loss of Fisher information for the exposure coefficient is governed solely by a distinct directional quantity called penalized collinear overlap Because real-world confounding combines smooth regional trends with sharp local jumps that escape any moderate basis dictionary, point identification remains fragile
Problem Setup and Model Formulation
The study uses an inhomogeneous Poisson point process over continuous space to model disease counts aggregated over administrative units The true unit-level additive risk vector is defined as the sum of known covariates, exposure effects, and an unobserved spatial latent field This latent field captures background confounding risk which inevitably overlaps with exposure over smooth spatial scales The working model approximates this unknown background field using a spatial kernel basis expansion with a quadratic roughness penalty
Spectral Decomposition of Latent Field Flexibility
The authors derive two distinct summary measures of latent field flexibility: the effective degrees of freedom EDF(λ) and the penalized collinear overlap ηpen(λ) EDF(λ) sums the shrinkage factors across all basis directions, measuring total fitting capacity regardless of where the exposure vector points By contrast, ηpen(λ) weights those shrinkage factors by the exposure energy shares pj(xW), measuring what fraction of exposure variation itself gets absorbed by the smoother Proposition 1 shows that this directional overlap, rather than total capacity, governs the effective information left for estimating β
Benchmark Partial Identification Framework
To address unmeasured confounding with unknown spatial structures, the authors develop a design-stage orthogonalization and partial identification method using an observable benchmark variable V This method measures how much bias a representative background factor removes by comparing estimates before and after adding the benchmark variable The resulting population interval is bounded by the true effect β in the set ΘΓ = [θa −Γd0, θa +Γd0]
Negative Control Calibration and Diagnostics
The authors introduce a negative control outcome YNC to trim away parts of the symmetric benchmark interval with the wrong bias sign Combining the benchmark variable with the negative control outcome in a three-dimensional confidence ellipsoid narrows the interval and flags cases where sources of evidence conflict The pre-reporting check event Gn is defined by three simple ratios that must hold for reporting valid results
Empirical Study and Conclusions
The empirical study on childhood respiratory mortality across England demonstrates that the multi-scale dictionary retains medium-scale variation with essentially the same spatial HAC variance as the 10 km specification The positivity of the NO2 effect therefore survives partial identification under a substantial departure from the calibrated benchmark The authors conclude that combining a multi-scale dictionary with an observable benchmark variable and a negative control outcome yields valid partial identification intervals Cn(Γ) and C NC n across transparent sensitivity bounds
References
BEST, N. G., ICKSTADT, K. & WOLPERT, R. L. (2000). Spatial Poisson regression for health and exposure data measured at disparate resolutions BOLIN, D. & WALLIN, J. p. 1 p. 1 (2026). Spatial self-confounding: smoothness-related estimation bias in spatial regression models CINELLI, C. p. 7 p. 7 & HAZLETT, C. p. 6 p. 6 (2020). Making sense of sensitivity: extending omitted variable bias DATTA, A. p. 1 p. 1 & STEIN, M. p. 1 p. 1 L. (2026). Infill consistent estimability of the regression slope between Gaussian random fields under spatial confounding DEPARTMENT FOR ENVIRONMENT, FOOD AND RURAL AFFAIRS (2024). p. 0 p. 0 Modelled background pollution data (1km grid NO2) DORN, J. p. 2 p. 2, GUO, K. & KALLUS, N. (2025). Doubly-valid/doubly-sharp sensitivity analysis for causal inference with unmeasured confounding DUPONT, E. p. 6 p. 6, WOOD, S. N. & AUGUSTIN, N. H. (2022). Spatial+: a novel approach to spatial confounding GUILLAUMIN, A. p. 1 p. 1 P., SYKULSKI, A. M., OLHEDE, S. C. & SIMONS, F. J. (2022). The debiased spatial Whittle likelihood IMBENS, G. p. 3 p. 3 W., KALLUS, N., MAO, X. & WANG, Y. (2025). Long-term causal inference under persistent confounding via data combination KHAN, K. p. 6 p. 6 & BERRETT, C. p. 1 p. 1 (2026). Re-thinking spatial confounding in spatial linear mixed models KHAN, K. p. 0 p. 0 & CALDER, C. p. 0 p. 0 A. (2022). Restricted spatial regression methods: implications for inference KÜNDIG, P. p. 1 p. 1 & SIGRIST, F. (2025). Iterative methods for Vecchia–Laplace approximations for latent Gaussian process models LI, C., SUN, S. & ZHU, Y. (2024). Fixed-domain posterior contraction rates for spatial Gaussian process model with nugget LLAMAZARES-ELIAS, L. p. 0 p. 0, LATZ, J. & LINDGREN, F. (2026). A parameterization of anisotropic Gaussian fields with penalized complexity priors MASTEN, M. p. 3 p. 3 A. & POIRIER, A. (2020). Inference on breakdown frontiers PACIOREK, C. p. 0 p. 0 J. (2010). The importance of scale for spatial-confounding bias and precision of spatial regression estimators ROCKOVÁ ˇ, V. p. 0 p. 0 & ROUSSEAU, J. (2024). Ideal Bayesian spatial adaptation STOYE, J. p. 0 p. 0 (2009). More on confidence intervals for partially identified parameters TAN, Z. p. 0 p. 0 (2024). Model-assisted sensitivity analysis for treatment effects under unmeasured confounding via regularized calibrated estimation UK HEALTH SECURITY AGENCY (2024). p. 6 p. 6 Public Health Profiles (Fingertips): Indicators 93260, 93275, 93114 and 93240 WIECHA, N. p. 1 p. 1, HOPPIN, J. A. & REICH, B. J. (2025). Two-stage estimators for spatial confounding with point-referenced data WIECHA, N. p. 1 p. 1, HOPPIN, J. A. & REICH, B. J., Two-stage estimators for spatial confounding with point-referenced data
Pruning redundant reasoning tokens
The authors show that the loss of effective information for the exposure coefficient is governed by a directional alignment measure called penalized collinear overlap rather than the effective degrees of freedom of the basis space This implies that no single smoothing scale can maximize effective information across all exposure patterns The authors also show that two spatial bases can have the exact same effective degrees of freedom EDF(λ), yet whichever basis aligns more closely with the dominant spatial pattern of exposure suffers a much larger drop in effective information
How the training signal is built
The framework builds a three-dimensional confidence ellipsoid by combining the benchmark variable, residualized exposure, and negative control outcome The final closed-form confidence interval Cn(Γ) is constructed by projecting this joint ellipse onto the one-dimensional interval endpoints using a smooth joint covariance estimator This projection resolves non-smoothness at d0 = 0, yielding substantially tighter intervals than conservative box methods
Where the gains come from
The gains in performance are realized when the working basis aligns with the unknown scale of unmeasured confounding The negative control calibration sharpens inference by flagging cases where the two sources of evidence conflict The empirical study confirms that using a multi-scale dictionary delivers the narrowest interval, and that the positivity of the NO2 effect survives partial identification under substantial departure from the calibrated benchmark The final diagnostic rule Gn ensures that only compatible replications are reported, providing robust inference
BEST, N. G., ICKSTADT, K. & WOLPERT, R. L. (2000). Spatial Poisson regression for health and exposure data measured at disparate resolutions BOLIN, D. & WALLIN, J. (2026). Spatial self-confounding: smoothness-related estimation bias in spatial regression models CINELLI, C. & HAZLETT, C. (2020). Making sense of sensitivity: extending omitted variable bias DATTA, A. & STEIN, M. L. (2026). Infill consistent estimability of the regression slope between Gaussian random fields under spatial confounding DEPARTMENT FOR ENVIRONMENT, FOOD AND RURAL AFFAIRS (2024). Modelled background pollution data (1km grid NO2) DORN, J., GUO, K. & KALLUS, N. (2025). Doubly-valid/doubly-sharp sensitivity analysis for causal inference with unmeasured confounding DUPONT, E., WOOD, S. N. & AUGUSTIN, N. H. (2022). Spatial+: a novel approach to spatial confounding GUILLAUMIN, A. P., SYKULSKI, A. M., OLHEDE, S. C. & SIMONS, F. J. (2022). The debiased spatial Whittle likelihood IMBENS, G. W., KALLUS, N., MAO, X. & WANG, Y. (2025). Long-term causal inference under persistent confounding via data combination KHAN, K. & BERRETT, C. (2026). Re-thinking spatial confounding in spatial linear mixed models KHAN, K. & CALDER, C. A. (2022). Restricted spatial regression methods: implications for inference KÜNDIG, P. & SIGRIST, F. (2025). Iterative methods for Vecchia–Laplace approximations for latent Gaussian process models LI, C., SUN, S. & ZHU, Y. (2024). Fixed-domain posterior contraction rates for spatial Gaussian process model with nugget LLAMAZARES-ELIAS, L., LATZ, J. & LINDGREN, F. (2026). A parameterization of anisotropic Gaussian fields with penalized complexity priors MASTEN, M. A. & POIRIER, A. (2020). Inference on breakdown frontiers PACIOREK, C. J. (2010). The importance of scale for spatial-confounding bias and precision of spatial regression estimators ROCKOVÁ ˇ, V. & ROUSSEAU, J. (2024). Ideal Bayesian spatial adaptation STOYE, J. (2009). More on confidence intervals for partially identified parameters TAN, Z. (2024). Model-assisted sensitivity analysis for treatment effects under unmeasured confounding via regularized calibrated estimation UK HEALTH SECURITY AGENCY (2024). Public Health Profiles (Fingertips): Indicators 93260, 93275, 93114 and 93240 WIECHA, N., HOPPIN, J. A. & REICH, B. J. (2025). Two-stage estimators for spatial confounding with point-referenced data WIECHA, N., HOPPIN, J. A. & REICH, B. J.
Green — the paper says it, and the page is printed. Red — no passage carries it, so treat that sentence as unverified. The same check runs on your own text: check a summary against its source, $5.
Improvements for AI systems
-
Directional identification of smoothing capacity allows for a more accurate assessment of estimator instability by decomposing it into total smoothing capacity (EDF) and directional overlap (penalized collinear overlap). This enables researchers to understand whether estimation instability stems from the overall latent random field or its alignment with exposure, providing a mechanistic understanding rather than just a numerical measure.
-
Development of a partial identification framework using an observable benchmark covariate bounds residual confounding bias by constructing bounds based on the change in the orthogonalized exposure estimate before and after adding this benchmark variable. This allows for valid confidence intervals even when the benchmark shift is close to zero, addressing the fragility of point identification under unknown spatial structures.
-
Incorporation of a negative control outcome sharpens inference by flagging assumption violations through a three-dimensional joint confidence ellipsoid that combines the benchmark variable with a negative control outcome. This flags cases where the two sources of evidence conflict, providing an additional diagnostic check beyond simple coverage checks on single-variable intervals.
-
Implementation of the joint ellipse projection interval provides asymptotically valid confidence sets across various sensitivity multipliers by resolving non-smoothness at zero for endpoint estimators like Imbens and Manski. This yields substantially tighter intervals than conservative methods while maintaining nominal identification-set coverage under weak benchmark settings.
-
The diagnostic pair of effective degrees of freedom (EDF) and penalized collinear overlap (penalized collinear overlap) provides a dual measure to clarify how much exposure signal a smoother absorbs versus total fitting capacity. This allows researchers to distinguish between smooth regional trends absorbed by the basis and local exposure variation retained outside the basis space.
-
The framework can be extended to mechanistic models by replacing an isotropic kernel with an advection diffusion Green function, which rotates singular vectors along physical transport directions to reduce directional overlap without cutting total capacity whenever background risk and exposure follow distinct spatial gradients. This allows for identification in complex physical settings where traditional methods fail.
Related papers
- Learning Robust Treatment Rules for Censored Data
- Neural Estimation of Summary Statistics for Simulation-Based Inference with Non-Asymptotic Guarantees
- Spectral divide-and-conquer MCMC for long stationary time series
- Improving the Efficiency of Subgroup Analysis in Randomized Controlled Trials with TMLE
- Personalized Federated Vector Autoregression with Personalization Diversity
- Doubly Robust and Efficient Calibration of Prediction Sets for Right-Censored Time-to-Event Outcomes