Aggregate Calibration Can Mask Stress-State Undercoverage: Bounded-Memory Forecast Intervals under Recurrent Financial Stress
stat.ME, q-fin.ST
Submitted: 2026-11-03
Updated: 2026-11-03
Comments: 18 pages, 1 figure, 11 tables
License: http://creativecommons.org/licenses/by/4.0/
The gist: Sequential forecast intervals are often evaluated by aggregate coverage even when calibration memory is bounded.
Terminology
Abstract
Sequential forecast intervals are often evaluated by aggregate coverage even when calibration memory is bounded. This can be misleading when economically important states recur after long absences: a recent-only buffer may satisfy its overall coverage target while no longer containing errors from earlier episodes of the returning state. We study this problem in next-day financial range forecasting, holding the forecasting model, conformity score, adaptive update, and memory budget constant while varying the historical residual information available at each query. Recent-only first-in, first-out (FIFO) calibration is near nominal in aggregate but undercovers substantially during high-volatility states in both an exchange-traded fund development panel and a fixed stock panel. An unbounded state-history reference yields a lower observed stress-period interval score; Rare replay yields lower high-VIX interval scores than the matched Recent-n and Hybrid-n controls in both panels, and the state-structured versus recent-only contrast is largest near stress re-entry. Bounded calibration memory is therefore part of the forecasting information design, and aggregate calibration alone can conceal state-specific reliability failures.
Sources
- Similarity-Based Prediction for Digital Twins: Panel Data, Theory, and Applications
- State-Matched Sequence Conformal Prediction
- Taming Tail Risk in Financial Markets: Conformal Calibration for Nonstationary Portfolio VaR
- Continual Calibration: Coverage Can Collapse Before Accuracy in Lifelong LLM Fine-Tuning
- AdaptNC: Adaptive Nonconformity Scores for Conformal Prediction under Distribution Shift
Related papers
- Learning Robust Treatment Rules for Censored Data
- Neural Estimation of Summary Statistics for Simulation-Based Inference with Non-Asymptotic Guarantees
- Spectral divide-and-conquer MCMC for long stationary time series
- Improving the Efficiency of Subgroup Analysis in Randomized Controlled Trials with TMLE
- Personalized Federated Vector Autoregression with Personalization Diversity
- Doubly Robust and Efficient Calibration of Prediction Sets for Right-Censored Time-to-Event Outcomes