SpatialUQ: Post-Hoc Uncertainty Quantification from Spatial Consistency in Black-Box Vision Models
cs.CV, cs.AI, cs.LG
Submitted: 2026-10-07
Updated: 2026-10-07
License: http://creativecommons.org/licenses/by/4.0/
The gist: Clinical vision models are often deployed as frozen black boxes with no access to internals, retraining, or ground truth at inference time.
Terminology
Abstract
Clinical vision models are often deployed as frozen black boxes with no access to internals, retraining, or ground truth at inference time. We introduce SpatialUQ, a post-hoc uncertainty method using only output probabilities. It measures the Jensen-Shannon divergence between the global prediction and the mean of five fixed spatial crops in six deterministic forward passes. The premise is simple, trustworthy predictions are spatially consistent. On NIH ChestX-ray14 (DenseNet-121, N = 25, 596), our Multicrop Uncertainty Score (MUS) reaches 0.784 failure-detection AUC versus 0.664 for MC-Dropout (p < 10-6) at one-fifth the compute, with native calibration (SCE = 0.049 vs. 0.127 for 1), the best-calibrated among methods above 0.78 AUC. A supervised fusion of MUS with entropy, confidence, and 1 reaches 0.832, outperforming a five-member ensemble (0.813). MUS scales with model quality, reaching 0.899 with BiomedCLIP (ρ= 0.846), while this relationship remains meaningful in-distribution (ρ= 0.523) but breaks down under severe distribution shift (VinBigData, ρ= 0.027). MUS is well-suited to diffuse findings but is less dependable for small focal lesions such as nodules. Code and experimental materials are publicly available at https://huggingface.co/datasets/kawsher11/SpatialUQ.
Sources
- Concrete Problems in AI Safety
- An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
- Deep Ensembles: A Loss Landscape Perspective
- Benchmarking Neural Network Robustness to Common Corruptions and Perturbations
- Distilling the Knowledge in a Neural Network
- Bayesian Active Learning for Classification and Preference Learning
- Enhancing The Reliability of Out-of-distribution Image Detection in Neural Networks
- Deep Deterministic Uncertainty: A Simple Baseline
- Uncertainty Baselines: Benchmarks for Uncertainty & Robustness in Deep Learning
- BiomedCLIP: a multimodal biomedical foundation model pretrained from fifteen million scientific image-text pairs
- A Novel Characterization of the Population Area Under the Risk Coverage Curve (AURC) and Rates of Finite Sample Estimators
Related papers
- Loss Knows Best: Detecting Annotation Errors in Videos via Loss Trajectories
- AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memories
- Benchmarking the Robustness of Foundation Models for Mammography under Domain Shift
- MambaX-Net: Dual-Input Mamba-Enhanced Cross-Attention Network for Longitudinal MRI Segmentation
- TeleOCR: Navigating Document Parsing Across Digital and Camera-Captured Documents
- A Survey on Efficient Vision-Language-Action Models