Latent Inference-Time Guidance of Time Series Foundation Models
stat.ML, cs.LG, stat.ME
Submitted: 2026-09-29
Updated: 2026-09-29
Comments: 22 pages, 8 figures
Code: https://github.com/Dralliag/opera-python
License: http://creativecommons.org/licenses/by-nc-sa/4.0/
The gist: Time Series Foundation Models (TSFMs) currently provide state-of-the-art results in forecasting tasks.
Terminology
Abstract
Time Series Foundation Models (TSFMs) currently provide state-of-the-art results in forecasting tasks. They are available out-of-the-box and rely on in-context learning to make their predictions, which makes the quality of their performance highly sensitive to the user-selected lookback, covariates, horizon and training data distributions. In practise, the quality of the forecasts are variable but complementary, which highlights the need for a principled ensembling approach, rather than selecting the best context. This paper introduces Latent Inference-Time Guidance for TSFMs, which adaptively combines a pool of TSFM forecasts through a time-dependent latent space with independent components. The framework comes equipped with identifiability and reconstruction guarantees, whilst maintaining the off-the-shelf aspect of foundation models. We provide experiments on datasets at various frequencies and from multiple domains: these show that the approach is competitive with traditional ensembling approaches.
Sources
- Chronos-2: From Univariate to Universal Forecasting
- Layer Normalization
- Conversational Time Series Foundation Models: Towards Explainable and Effective Forecasting
- Importance sampling for online variational learning
- TabPFN-2.5: Advancing the State of the Art in Tabular Foundation Models
- No Other Representation Component Is Needed: Diffusion Transformers Can Provide Representation Guidance by Themselves
- Moirai 2.0: When Less Is More for Time Series Forecasting
- Statistical Guarantees for Variational Autoencoders using PAC-Bayesian Theory
- Brittlebench: Quantifying LLM robustness via prompt sensitivity
Related papers
- Behavior of prediction performance metrics with rare events
- Optimal Estimation of Generic Dynamics by Path-Dependent Neural Jump ODEs
- A Posterior-Dynamics Framework for Imaging Inverse Problems with Pretrained Diffusion Priors
- Efficient quadratic entropy with distance sketches
- Embedding-Bias in Conditional Independence Testing
- From Log-Odds to Shapley Values: An Explanatory Geometry for the Weighted Naive Bayes Classifier