Information-Geometric Blind Spots of Conformal Test Martingales
stat.ML, cs.LG, math.ST, stat.TH
Submitted: 2026-10-16
Updated: 2026-10-16
Comments: 9 pages, 5 figures
License: http://creativecommons.org/licenses/by/4.0/
The gist: Conformal test martingales (CTMs) are e-processes for sequentially testing exchangeability via p-values produced by a conformity function A.
Abstract
Conformal test martingales (CTMs) are e-processes for sequentially testing exchangeability via p-values produced by a conformity function A. However, any distribution shift that preserves the push-forward P A-1 leaves the p-value distribution invariant, rendering it invisible to every CTM based on A. We formalise this blind spot through the A-equivalence class [P] A and show that, for any target distribution T, there is a unique closest element Q in[P] A in KL divergence---the A-cryptic I-projection---with explicit density q(z) = t(z),p S(A(z))/t S(A(z)) and a Pythagorean decomposition into detectable and cryptic components. When A is the Neyman-Pearson likelihood ratio, the cryptic component vanishes, connecting our result to optimal e-value design. We demonstrate the theory on high-dimensional image data by empirically constructing this I-projection. By conditionally resampling EMNIST letters to identically match the conformity scores of MNIST digits, we demonstrate that a distribution can be shifted to a disjoint support while leaving the test martingale mathematically blinded.
Related papers
- Behavior of prediction performance metrics with rare events
- Optimal Estimation of Generic Dynamics by Path-Dependent Neural Jump ODEs
- A Posterior-Dynamics Framework for Imaging Inverse Problems with Pretrained Diffusion Priors
- Efficient quadratic entropy with distance sketches
- Embedding-Bias in Conditional Independence Testing
- From Log-Odds to Shapley Values: An Explanatory Geometry for the Weighted Naive Bayes Classifier