INLA-RF: A Hybrid Modeling Strategy for Spatio-Temporal Environmental Data
Listen
Radio episode about this paper
Transcript
Introduction to the show: ident: Statistics. The day in statistics: methods, theory and the inference under them.
Tom: We're looking at the paper: "INLA-RF: A Hybrid Modeling Strategy for Spatio-Temporal Environmental Data".
Jane: Here's the gist of the paper. Environmental processes often exhibit complex, non-linear patterns and discontinuities across space and time, posing significant challenges for traditional geostatistical modeling approaches.
Tom: In this paper, we propose a hybrid modeling strategy that combines the interpretability and principled uncertainty quantification of statistical models with the predictive flexibility of machine learning methods.
Jane: Overall, the results indicate that INLA-RF can improve spatiotemporal predictive accuracy while retaining interpretability and providing coherent uncertainty estimates.
Tom: Hybrid Modeling Strategy The proposed framework introduces two novel algorithms collectively named INLA-RF, which iteratively couple a Bayesian spatiotemporal model fitted via the INLA-SPDE approach with Random Forest.
Paper summary: Tom: So, wrapping up the INLA-RF: A Hybrid Modeling Strategy for Spatio-Temporal Environmental Data paper. The authors are proposing this hybrid approach to model complex environmental data across space and time by combining Bayesian modeling with machine learning to get both prediction and uncertainty quantification.
Jane: They introduce the INLA-RF algorithms which iteratively couple the INLA SPDE approach with Random Forest, allowing for uncertainty propagation across modeling stages, plus they have that Kullback-Leibler divergence based stopping criterion.
Lu: The main implication is that this hybrid strategy can improve spatiotemporal predictive accuracy in challenging settings while retaining the interpretability from statistical models and providing coherent uncertainty estimates.
Meng: For deployment, it seems like INLA-RF1 is the go-to if you want to boost performance with minimal added complexity, but you have to be careful about that uncertainty width.
Tom: And if you need targeted fixes for specific regions, like structural breaks, INLA-RF2 offers a localized adjustment mechanism.
Jane: The paper suggests that for complex environmental problems where standard tools struggle with non-linear patterns and discontinuities, this type of synergy between Bayesian inference and machine learning is a way forward.
Lu: They’ve provided two distinct paths—the offset correction and the targeted node level correction—which lets you choose the right tool for your specific modeling objective.
Meng: It's helpful to know that they acknowledge that their method stops where it needs to, using the KLD measure instead of just running a set number of fixed iterations.
Tom: That principled stopping criterion is key because it controls the procedure and reduces the risk of overfitting when you're training these complex models.
Conclusion: Tom: So, we're at the end of this segment talking about INLA-RF, that hybrid modeling strategy for environmental data.
Jane: It’s really about taking these complex, non-linear patterns in space and time and using a blend of Bayesian statistics and machine learning to get better predictions while still keeping things interpretable.
Lu: The authors did this by coupling the INLA approach, which handles that spatio-temporal dependence, with Random Forest to learn the rest of the structure left over in the residuals.
Meng: From a deployment side, it seems they’ve got two main options depending on what you need: one for general accuracy and one for fixing specific spots where things are weird.
Tom: Right, so we're looking at these two ways to use it: INLA-RF1 which is about improving overall predictions with less extra modeling work, and INLA-RF2 which targets specific regions of the latent field.
Jane: And the big idea here is that this method provides not just a prediction but a proper measure of how uncertain those predictions actually are.
Lu: They use an iterative process driven by something called Kullback-Leibler divergence to decide when to stop training, which keeps it from running forever and overfitting.
Tom: It sounds like they’re trying to build something that is both flexible enough for messy environmental data and still provides those solid statistical estimates we need.
Jane: But the real question is, how much better is this actually compared to just using one of the existing tools on its own?
Lu: The results show it can significantly improve predictive accuracy in challenging settings, particularly when you look at real-world data like air pollution.
Meng: And in that pollution study, they saw the root mean square error drop from nearly one point to about zero point two with INLA-RF2. That's a pretty big jump for a model that has to run constantly.
Tom: A jump from zero point nine three down to zero point two two is substantial; that tells you there’s real value in adding this machine learning component when the data is behaving strangely.
Jane: So, what does this mean for someone who just looks at a map of environmental data and wants a reliable forecast?
Lu: It means we have a new way to model those tricky dependencies without having to guess all the complex interactions ourselves upfront.
Meng: I'm still watching how it runs on live traffic; if you can’t deploy this reliably, it’s just an interesting math problem.
Tom: Exactly, but the authors are suggesting INLA-RF1 is a good starting point if you want to boost performance without adding too much complexity right away.
Jane: And for those specific issues in the data that need local fixing, they have this targeted correction method we should keep an eye on.
Lu: So, these hybrid models are showing promise for tackling the kind of messy spatio-temporal problems that standard methods just can't handle well anymore.
Mario Figueiraa, Michela Camelettib, *, Luca Patellib
Department of Statistics and Operations Research, University of Valencia · Department of Economics, University of Bergamo
stat.ME
Submitted: 2025-07-24
Updated: 2026-05-05
Journal ref: 226 (2027) 108481
DOI: 10.1016/j.csda.2026.108481
Code: https://github.com/LucaPate/INLA-RF
License: http://creativecommons.org/licenses/by/4.0/
Importance score: 77/100
The gist: Environmental processes often exhibit complex, non-linear patterns and discontinuities across space and time, posing significant challenges for traditional geostatistical modeling approaches.
Key concepts
- INLA-SPDE approach
- This is the initial step in the iterative process where a Bayesian spatiotemporal model is fitted using the INLA (Integrated Nested Laplace Approximation) method applied to Stochastic Partial Differential Equations (SPDEs). This part of the model captures how environmental data changes across both space and time, establishing a foundational structure for prediction.
- Random Forest
- This machine learning algorithm is used in the second step of INLA-RF. It learns the remaining, unmodeled structure or patterns within the residuals left by the initial Bayesian model. Essentially, it acts as a flexible tool to capture complex relationships that traditional statistical models might miss.
- INLA-RF1 and INLA-RF2
- These are two specific refinement mechanisms. INLA-RF1 uses an offset approach where Random Forest estimates a correction term added to the main model. INLA-RF2 performs a localized adjustment by adding random effects only at specific nodes in the latent field, targeting areas needing correction.
- Kullback-Leibler divergence (KLD)
- This metric is used as the stopping criterion for the iterative refinement process. It measures how much the posterior distribution of the model changes between successive iterations. When this change falls below a certain threshold, it indicates that further iterations are not providing significant improvement, thus stopping the process efficiently.
Terminology
Summary
Environmental processes often exhibit complex, non-linear patterns and discontinuities across space and time, posing significant challenges for traditional geostatistical modeling approaches. p. 0 INLA-RF: A Hybrid Modeling Strategy for
Spatio-Temporal Environmental Data
Mario Figueiraa
, Michela Camelettib,∗
, Luca Patellib
aDepartment of Statistics and Operations Research, University of
Valencia, Valencia, Spain
bDepartment of Economics, University of Bergamo, Bergamo, Italy
Abstract
Environmental processes often exhibit complex, non-linear patterns and discontinuities across space and time, posing significant challenges for traditional geostatistical modeling approaches. In this paper, we propose a hybrid
modeling strategy that combines the interpretability and principled uncertainty quantification of statistical models with the predictive flexibility of
machine learning methods. INLA-RF: A Hybrid Modeling Strategy for
Spatio-Temporal Environmental Data
Mario Figueiraa
, Michela Camelettib,∗
, Luca Patellib
aDepartment of Statistics and Operations Research, University of
Valencia, Valencia, Spain
bDepartment of Economics, University of Bergamo, Bergamo, Italy
Abstract
Environmental processes often exhibit complex, non-linear patterns and discontinuities across space and time, posing significant challenges for traditional geostatistical modeling approaches. In this paper, we propose a hybrid
modeling strategy that combines the interpretability and principled uncertainty quantification of statistical models with the predictive flexibility of
machine learning methods. We assess the predictive performance and uncertainty quantification of
the INLA-RF algorithms using two simulation studies and a real air pollution
application. Overall, the results indicate that INLA-RF can improve spatiotemporal predictive accuracy while retaining interpretability and providing
coherent uncertainty estimates.Where the paper says it
Where the paper says it
Where the paper says it
Hybrid Modeling Strategy
The proposed framework introduces two novel algorithms collectively named INLA-RF, which iteratively couple a Bayesian spatiotemporal model fitted via the INLA-SPDE approach with Random Forest. These algorithms follow an iterative two-stage scheme where the INLA-SPDE based model captures spatio-temporal dependence and RF learns remaining structure in the residuals. p. 2 To this end, we propose two novel algorithms, collectively denoted as INLA-RF, which couple
a parametric spatio-temporal LGM with a well-established ML algorithm
as Random Forest (RF, Breiman, 2001). Both INLA-RF algorithms follow an iterative two-stage scheme: the INLA-SPDE based model captures
spatio-temporal dependence, whereas RF learns remaining structure in the
residuals and enhances predictive flexibility. Both INLA-RF algorithms follow an iterative two-stage scheme: the INLA-SPDE based model captures
spatio-temporal dependence, whereas RF learns remaining structure in the
residuals and enhances predictive flexibility. Beyond the residual-learning
backbone, we introduce explicit propagation of RF predictive uncertainty
into the INLA-SPDE stage and propose two complementary feedback mechanisms: an offset-based mean correction (INLA-RF1) and a targeted nodelevel correction of the LGM latent field, focusing on stress points selected
considering where the INLA-SPDE fit is most uncertain or least accurate
(INLA-RF2).Where the paper says it
Where the paper says it
Iterative Refinement Mechanisms
The two INLA-RF algorithms operate by alternating between fitting the parametric spatio-temporal LGM with INLA (STEP 1) and training RF on the resulting residuals to learn remaining structure (STEP 2). The stopping criterion for this iterative scheme is based on the Kullback-Leibler divergence (KLD), which determines the number of iterations by measuring how much the posterior distribution changes between iterations. p. 3 For both INLA-RF algorithms we use the Kullback-Leibler divergence
(KLD) as a stopping criterion. This means that the number of iterations
of the iterative two-stage scheme is not a tuning parameter but is instead
determined by an empirical measure of how much the posterior distribution
changes between iterations. INLA-RF2: latent field nodes correction
INLA-RF2 uses the RF output to correct a selected subset of latent field
nodes. Unlike INLA-RF1, which applies a mean correction through an offset in the linear predictor, INLA-RF2 performs a localized adjustment by
augmenting the LGM with an additional IID random effect indexed only on
a selected set of indices K (hereafter also referred to as locations or stress
nodes), corresponding to the nodes identified for the correction.Where the paper says it
Where the paper says it
Performance Evaluation Metrics
The predictive performance of the INLA-RF algorithms is assessed using several metrics, including Root Mean Square Error (RMSE), Mean Absolute Error (MAE), Coverage Probability (CP), and Average Interval Width (AIW). In simulation studies, INLA-RF1 showed that applying the algorithm without uncertainty propagation resulted in more precise predictions, while including uncertainty propagation led to a wider predictive distribution. p. 8 while DKL ≥ δ do
STEP 1 (INLA with offset):
Compute the updated response y
(i) = y − eˆ
(i−1)
RF . if uncertainty propagation == TRUE then
Fit the LGM(A, x, θ) using y
(i) as response and including a fixed
variance component given by σˆ
2(i−1)
RF (OOB-MSE) in the Gaussian
likelihood through precoffset. 3 presents
the core contribution of the paper, namely the two novel INLA-RF algorithms (INLA-RF1 and INLA-RF2), together with their pseudo-code and
implementation details. The empirical evaluation includes two simulation
studies and a real case study with air pollution data, discussed in Section 3
and 4, respectively. INLA-RF: A Hybrid Modeling Strategy for
Spatio-Temporal Environmental Data
Mario Figueiraa
, Michela Camelettib,∗
, Luca Patellib
aDepartment of Statistics and Operations Research, University of
Valencia, Valencia, Spain
bDepartment of Economics, University of Bergamo, Bergamo, Italy
Abstract
Environmental processes often exhibit complex, non-linear patterns and discontinuities across space and time, posing significant challenges for traditional geostatistical modeling approaches. In this paper, we propose a hybrid
modeling strategy that combines the interpretability and principled uncertainty quantification of statistical models with the predictive flexibility of
machine learning methods. This means that
more uncertain RF corrections are accompanied by a larger observation-level
variance contribution, effectively reducing the influence of the offset correction. INLA-RF2: latent field nodes correction
INLA-RF2 uses the RF output to correct a selected subset of latent field
nodes.Where the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
Model Selection and Application
The choice between INLA-RF1 and INLA-RF2 depends on the modeling objective; INLA-RF1 is preferable when the goal is to improve overall predictive performance with minimal additional modeling complexity. In contrast, INLA-RF2 is more suitable when the interest lies in correcting specific regions of the latent field, such as in the presence of structural breaks or localized misspecification. p. 7 INLA-RF2: latent field nodes correction
INLA-RF2 uses the RF output to correct a selected subset of latent field
nodes. Unlike INLA-RF1, which applies a mean correction through an offset in the linear predictor, INLA-RF2 performs a localized adjustment by
augmenting the LGM with an additional IID random effect indexed only on
a selected set of indices K (hereafter also referred to as locations or stress
nodes), corresponding to the nodes identified for the correction. Moreover, the number of observations associated with each node may vary,
and different components of the latent field may be candidates for correction. In the INLA-RF2 construction, the RF-based information enters the
model through an explicit latent component, thereby enabling a straightforward uncertainty propagation within the INLA framework.Where the paper says it
Where the paper says it
Conclusion and Future Directions
The proposed hybrid approaches can improve predictive accuracy in challenging spatio-temporal settings by combining the strengths of Bayesian modeling and machine learning. INLA-RF1 is recommended when improving overall predictive performance with minimal complexity is desired. p. 0 We assess the predictive performance and uncertainty quantification of
the INLA-RF algorithms using two simulation studies and a real air pollution
application. Overall, the results indicate that INLA-RF can improve spatiotemporal predictive accuracy while retaining interpretability and providing
coherent uncertainty estimates. For both INLA-RF algorithms we use the Kullback-Leibler divergence
(KLD) as a stopping criterion. This means that the number of iterations
of the iterative two-stage scheme is not a tuning parameter but is instead
determined by an empirical measure of how much the posterior distribution
changes between iterations.Where the paper says it
Where the paper says it
Author Contributions
The authors contributed to the paper as follows: Conceptualization was done by MC, MF, LP. Methodology was provided by MC, MF. p. 3 Supplementary material is provided in the appendices: Appendix B
presents the predictive performance metrics and the KLD-based stopping criterion, Appendix C reports details about the simulation case studies, while
Appendix D contains supplementary results regarding the real case study. Methodology
2. 2 provides the essential
background and notation for INLA-SPDE and RF, limited to the elements
required to follow our proposal; additional details are deferred to Appendix A
for the readers who are not familiar with these methods. 3 presents
the core contribution of the paper, namely the two novel INLA-RF algorithms (INLA-RF1 and INLA-RF2), together with their pseudo-code and
implementation details. INLA-RF: A Hybrid Modeling Strategy for
Spatio-Temporal Environmental Data
Mario Figueiraa
, Michela Camelettib,∗
, Luca Patellib
aDepartment of Statistics and Operations Research, University of
Valencia, Valencia, Spain
bDepartment of Economics, University of Bergamo, Bergamo, Italy
Abstract
Environmental processes often exhibit complex, non-linear patterns and discontinuities across space and time, posing significant challenges for traditional geostatistical modeling approaches. In this paper, we propose a hybrid
modeling strategy that combines the interpretability and principled uncertainty quantification of statistical models with the predictive flexibility of
machine learning methods. Section 5 concludes the paper with a discussion and final
remarks. Supplementary material is provided in the appendices: Appendix B
presents the predictive performance metrics and the KLD-based stopping criterion, Appendix C reports details about the simulation case studies, while
Appendix D contains supplementary results regarding the real case study.Where the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
Funding and Availability
The authors acknowledge support from Grant PID2022-136455NB-I00, funded by Ministerio de Ciencia, Innovación y Universidades of Spain (MCIN/AEI/10.13039/501100011033/FEDER, UE) and the European Regional Development Fund. The code for generating the data for the two simulation studies, as well as for implementing the proposed algorithms, is publicly available on GitHub at https://github. p. 3 3 presents
the core contribution of the paper, namely the two novel INLA-RF algorithms (INLA-RF1 and INLA-RF2), together with their pseudo-code and
implementation details. The empirical evaluation includes two simulation
studies and a real case study with air pollution data, discussed in Section 3
and 4, respectively. These quantities are used to assess
convergence of the INLA-RF algorithms via the Kullback-Leibler divergence
(see Appendix B. RF is an ensemble of regression trees; each tree is fit on a bootstrap
resample of the training data (Breiman, 2001).Where the paper says it
Where the paper says it
Declaration of Generative AI
During the preparation of this work the authors used OpenAI (2026) in order to improve the readability and language of the manuscript. The authors reviewed and edited the content as needed and take full responsibility for the content of the published article. p. 7 Identifying
the stress nodes is the most delicate step of the algorithm. To the authors’
knowledge, there is no single, well-defined criterion for selecting either the
number or the location of these nodes.Where the paper says it
References
The references listed include works such as Breiman (2001) on Random Forests. Cameletti et al. p. 0 Keywords: Hybrid models, INLA, Random Forest, SPDE, Latent Gaussian
Models, Uncertainty propagation
∗Corresponding author
Email address: michela. cameletti@unibg. Moreover, it allows for posterior predictive
distributions of the response variable, enabling spatial prediction at any location within the domain of interest. The INLA-SPDE approach is already a powerful and computationally efficient solution for spatio-temporal modeling, providing fast Bayesian inference
and principled uncertainty quantification. These models rely on
the likelihood function for inference, ensuring a proper quantification of uncertainty. In particular, within a Bayesian framework, the well-established
INLA-SPDE approach1
(Rue et al. In particular, within a Bayesian framework, the well-established
INLA-SPDE approach1
(Rue et al. , 2009; Lindgren et al. , 2011b, 2022) as a valid and computationally efficient solution for fast LGM estimation and spatial prediction. In particular, since the INLA-SPDE approach adopts a Bayesian framework,
it provides posterior distributions for all unknown parameters, including the
spatially and temporally structured random effects, with uncertainty quantification being straightforward. The aim of this paper is to improve the predictive accuracy of spatiotemporal statistical models fitted via the INLA-SPDE approach, while preserving interpretability and uncertainty quantification. To this end, we propose two novel algorithms, collectively denoted as INLA-RF, which couple
a parametric spatio-temporal LGM with a well-established ML algorithm
as Random Forest (RF, Breiman, 2001).Where the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
Where the paper says it
Green — the paper says it, and the page is printed. Red — no passage carries it, so treat that sentence as unverified. The same check runs on your own text: check a summary against its source, $5.
Improvements for AI systems
-
Improved predictive accuracy for spatio-temporal data by iteratively coupling a Bayesian spatiotemporal model fitted via INLA-SPDE with Random Forest, allowing it to
improve spatiotemporal predictive accuracy while retaining interpretability and providing coherent uncertainty estimates.
-
Enhanced uncertainty quantification across modeling stages by proposing the explicit propagation of RF predictive uncertainty into the INLA stage, which involves using the
INLA precoffset option
to include a fixed variance component in the Gaussian likelihood. -
Capture of abrupt changes and discontinuities in latent fields through localized adjustment by introducing INLA-RF2, which performs a
targeted nodelevel correction of the LGM latent field
by augmenting the model with an additional IID random effect indexed only on selected stress nodes. -
Computational efficiency and risk reduction through an effective stopping criterion, where the number of iterations is determined by the Kullback-Leibler divergence (KLD) based on
how much the posterior distribution changes between iterations.
-
Model selection strategy flexibility: INLA-RF1 can be used when
the goal is to improve overall predictive performance with minimal additional modeling complexity,
while INLA-RF2 is more suitablewhen the interest lies in correcting specific regions of the latent field, for example in the presence of structural breaks or localized misspecification.
Abstract
Environmental processes often exhibit complex, non-linear patterns and discontinuities across space and time, posing significant challenges for traditional geostatistical modeling approaches. In this paper, we propose a hybrid spatio-temporal modeling framework that combines the interpretability and uncertainty quantification of Bayesian models -- estimated using the INLA-SPDE approach -- with the predictive power and flexibility of Random Forest (RF). Specifically, we introduce two novel algorithms, collectively named INLA-RF, which integrate a statistical spatio-temporal model with RF in an iterative two-stage framework. The first algorithm (INLA-RF1) incorporates RF predictions as an offset in the INLA-SPDE model, while the second (INLA-RF2) uses RF to directly correct selected latent field nodes. Both hybrid strategies enable uncertainty propagation between modeling stages, an aspect often overlooked in existing hybrid approaches. In addition, we propose a Kullback-Leibler divergence-based stopping criterion. We evaluate the predictive performance and uncertainty quantification capabilities of the proposed algorithms through two simulation studies. Results suggest that our hybrid approach enhances spatio-temporal prediction while maintaining interpretability and coherence in uncertainty estimates.
Related papers
- Learning Robust Treatment Rules for Censored Data
- Neural Estimation of Summary Statistics for Simulation-Based Inference with Non-Asymptotic Guarantees
- Spectral divide-and-conquer MCMC for long stationary time series
- Improving the Efficiency of Subgroup Analysis in Randomized Controlled Trials with TMLE
- Personalized Federated Vector Autoregression with Personalization Diversity
- Doubly Robust and Efficient Calibration of Prediction Sets for Right-Censored Time-to-Event Outcomes