INLA-RF: A Hybrid Modeling Strategy for Spatio-Temporal Environmental Data

arXiv:2507.18488 · stat.ME · Submitted 2025-07-24 · Read on arXiv

Listen

Radio episode about this paper

Transcript

Introduction to the show: ident: Statistics. The day in statistics: methods, theory and the inference under them.

Tom: We're looking at the paper: "INLA-RF: A Hybrid Modeling Strategy for Spatio-Temporal Environmental Data".

Jane: Here's the gist of the paper. Environmental processes often exhibit complex, non-linear patterns and discontinuities across space and time, posing significant challenges for traditional geostatistical modeling approaches.

Tom: In this paper, we propose a hybrid modeling strategy that combines the interpretability and principled uncertainty quantification of statistical models with the predictive flexibility of machine learning methods.

Jane: Overall, the results indicate that INLA-RF can improve spatiotemporal predictive accuracy while retaining interpretability and providing coherent uncertainty estimates.

Tom: Hybrid Modeling Strategy The proposed framework introduces two novel algorithms collectively named INLA-RF, which iteratively couple a Bayesian spatiotemporal model fitted via the INLA-SPDE approach with Random Forest.

Paper summary: Tom: So, wrapping up the INLA-RF: A Hybrid Modeling Strategy for Spatio-Temporal Environmental Data paper. The authors are proposing this hybrid approach to model complex environmental data across space and time by combining Bayesian modeling with machine learning to get both prediction and uncertainty quantification.

Jane: They introduce the INLA-RF algorithms which iteratively couple the INLA SPDE approach with Random Forest, allowing for uncertainty propagation across modeling stages, plus they have that Kullback-Leibler divergence based stopping criterion.

Lu: The main implication is that this hybrid strategy can improve spatiotemporal predictive accuracy in challenging settings while retaining the interpretability from statistical models and providing coherent uncertainty estimates.

Meng: For deployment, it seems like INLA-RF1 is the go-to if you want to boost performance with minimal added complexity, but you have to be careful about that uncertainty width.

Tom: And if you need targeted fixes for specific regions, like structural breaks, INLA-RF2 offers a localized adjustment mechanism.

Jane: The paper suggests that for complex environmental problems where standard tools struggle with non-linear patterns and discontinuities, this type of synergy between Bayesian inference and machine learning is a way forward.

Lu: They’ve provided two distinct paths—the offset correction and the targeted node level correction—which lets you choose the right tool for your specific modeling objective.

Meng: It's helpful to know that they acknowledge that their method stops where it needs to, using the KLD measure instead of just running a set number of fixed iterations.

Tom: That principled stopping criterion is key because it controls the procedure and reduces the risk of overfitting when you're training these complex models.

Conclusion: Tom: So, we're at the end of this segment talking about INLA-RF, that hybrid modeling strategy for environmental data.

Jane: It’s really about taking these complex, non-linear patterns in space and time and using a blend of Bayesian statistics and machine learning to get better predictions while still keeping things interpretable.

Lu: The authors did this by coupling the INLA approach, which handles that spatio-temporal dependence, with Random Forest to learn the rest of the structure left over in the residuals.

Meng: From a deployment side, it seems they’ve got two main options depending on what you need: one for general accuracy and one for fixing specific spots where things are weird.

Tom: Right, so we're looking at these two ways to use it: INLA-RF1 which is about improving overall predictions with less extra modeling work, and INLA-RF2 which targets specific regions of the latent field.

Jane: And the big idea here is that this method provides not just a prediction but a proper measure of how uncertain those predictions actually are.

Lu: They use an iterative process driven by something called Kullback-Leibler divergence to decide when to stop training, which keeps it from running forever and overfitting.

Tom: It sounds like they’re trying to build something that is both flexible enough for messy environmental data and still provides those solid statistical estimates we need.

Jane: But the real question is, how much better is this actually compared to just using one of the existing tools on its own?

Lu: The results show it can significantly improve predictive accuracy in challenging settings, particularly when you look at real-world data like air pollution.

Meng: And in that pollution study, they saw the root mean square error drop from nearly one point to about zero point two with INLA-RF2. That's a pretty big jump for a model that has to run constantly.

Tom: A jump from zero point nine three down to zero point two two is substantial; that tells you there’s real value in adding this machine learning component when the data is behaving strangely.

Jane: So, what does this mean for someone who just looks at a map of environmental data and wants a reliable forecast?

Lu: It means we have a new way to model those tricky dependencies without having to guess all the complex interactions ourselves upfront.

Meng: I'm still watching how it runs on live traffic; if you can’t deploy this reliably, it’s just an interesting math problem.

Tom: Exactly, but the authors are suggesting INLA-RF1 is a good starting point if you want to boost performance without adding too much complexity right away.

Jane: And for those specific issues in the data that need local fixing, they have this targeted correction method we should keep an eye on.

Lu: So, these hybrid models are showing promise for tackling the kind of messy spatio-temporal problems that standard methods just can't handle well anymore.

Mario Figueiraa, Michela Camelettib, *, Luca Patellib

Department of Statistics and Operations Research, University of Valencia · Department of Economics, University of Bergamo

stat.ME

Submitted: 2025-07-24

Updated: 2026-05-05

Journal ref: 226 (2027) 108481

DOI: 10.1016/j.csda.2026.108481

Code: https://github.com/LucaPate/INLA-RF

License: http://creativecommons.org/licenses/by/4.0/

Importance score: 77/100

The gist: Environmental processes often exhibit complex, non-linear patterns and discontinuities across space and time, posing significant challenges for traditional geostatistical modeling approaches.

Key concepts

INLA-SPDE approach
This is the initial step in the iterative process where a Bayesian spatiotemporal model is fitted using the INLA (Integrated Nested Laplace Approximation) method applied to Stochastic Partial Differential Equations (SPDEs). This part of the model captures how environmental data changes across both space and time, establishing a foundational structure for prediction.
Random Forest
This machine learning algorithm is used in the second step of INLA-RF. It learns the remaining, unmodeled structure or patterns within the residuals left by the initial Bayesian model. Essentially, it acts as a flexible tool to capture complex relationships that traditional statistical models might miss.
INLA-RF1 and INLA-RF2
These are two specific refinement mechanisms. INLA-RF1 uses an offset approach where Random Forest estimates a correction term added to the main model. INLA-RF2 performs a localized adjustment by adding random effects only at specific nodes in the latent field, targeting areas needing correction.
Kullback-Leibler divergence (KLD)
This metric is used as the stopping criterion for the iterative refinement process. It measures how much the posterior distribution of the model changes between successive iterations. When this change falls below a certain threshold, it indicates that further iterations are not providing significant improvement, thus stopping the process efficiently.

Terminology

Summary

Environmental processes often exhibit complex, non-linear patterns and discontinuities across space and time, posing significant challenges for traditional geostatistical modeling approaches. p. 0

Where the paper says it

INLA-RF: A Hybrid Modeling Strategy for Spatio-Temporal Environmental Data Mario Figueiraa , Michela Camelettib,∗ , Luca Patellib aDepartment of Statistics and Operations Research, University of Valencia, Valencia, Spain bDepartment of Economics, University of Bergamo, Bergamo, Italy Abstract Environmental processes often exhibit complex, non-linear patterns and discontinuities across space and time, posing significant challenges for traditional geostatistical modeling approaches. In this paper, we propose a hybrid modeling strategy that combines the interpretability and principled uncertainty quantification of statistical models with the predictive flexibility of machine learning methods.

In this paper, we propose a hybrid modeling strategy that combines the interpretability and principled uncertainty quantification of statistical models with the predictive flexibility of machine learning methods. p. 0
Where the paper says it

INLA-RF: A Hybrid Modeling Strategy for Spatio-Temporal Environmental Data Mario Figueiraa , Michela Camelettib,∗ , Luca Patellib aDepartment of Statistics and Operations Research, University of Valencia, Valencia, Spain bDepartment of Economics, University of Bergamo, Bergamo, Italy Abstract Environmental processes often exhibit complex, non-linear patterns and discontinuities across space and time, posing significant challenges for traditional geostatistical modeling approaches. In this paper, we propose a hybrid modeling strategy that combines the interpretability and principled uncertainty quantification of statistical models with the predictive flexibility of machine learning methods.

Overall, the results indicate that INLA-RF can improve spatiotemporal predictive accuracy while retaining interpretability and providing coherent uncertainty estimates. p. 0
Where the paper says it

We assess the predictive performance and uncertainty quantification of the INLA-RF algorithms using two simulation studies and a real air pollution application. Overall, the results indicate that INLA-RF can improve spatiotemporal predictive accuracy while retaining interpretability and providing coherent uncertainty estimates.

Hybrid Modeling Strategy

The proposed framework introduces two novel algorithms collectively named INLA-RF, which iteratively couple a Bayesian spatiotemporal model fitted via the INLA-SPDE approach with Random Forest. These algorithms follow an iterative two-stage scheme where the INLA-SPDE based model captures spatio-temporal dependence and RF learns remaining structure in the residuals. p. 2

Where the paper says it

To this end, we propose two novel algorithms, collectively denoted as INLA-RF, which couple a parametric spatio-temporal LGM with a well-established ML algorithm as Random Forest (RF, Breiman, 2001). Both INLA-RF algorithms follow an iterative two-stage scheme: the INLA-SPDE based model captures spatio-temporal dependence, whereas RF learns remaining structure in the residuals and enhances predictive flexibility.

Beyond this backbone, the authors introduce explicit propagation of RF predictive uncertainty into the INLA stage and propose two complementary feedback mechanisms: an offset-based mean correction (INLA-RF1) and a targeted nodelevel correction of the LGM latent field (INLA-RF2). p. 2
Where the paper says it

Both INLA-RF algorithms follow an iterative two-stage scheme: the INLA-SPDE based model captures spatio-temporal dependence, whereas RF learns remaining structure in the residuals and enhances predictive flexibility. Beyond the residual-learning backbone, we introduce explicit propagation of RF predictive uncertainty into the INLA-SPDE stage and propose two complementary feedback mechanisms: an offset-based mean correction (INLA-RF1) and a targeted nodelevel correction of the LGM latent field, focusing on stress points selected considering where the INLA-SPDE fit is most uncertain or least accurate (INLA-RF2).

Iterative Refinement Mechanisms

The two INLA-RF algorithms operate by alternating between fitting the parametric spatio-temporal LGM with INLA (STEP 1) and training RF on the resulting residuals to learn remaining structure (STEP 2). The stopping criterion for this iterative scheme is based on the Kullback-Leibler divergence (KLD), which determines the number of iterations by measuring how much the posterior distribution changes between iterations. p. 3

Where the paper says it

For both INLA-RF algorithms we use the Kullback-Leibler divergence (KLD) as a stopping criterion. This means that the number of iterations of the iterative two-stage scheme is not a tuning parameter but is instead determined by an empirical measure of how much the posterior distribution changes between iterations.

INLA-RF1 utilizes an offset approach where RF estimates a correction term incorporated into the INLA-based model as an offset, while INLA-RF2 performs a localized adjustment by augmenting the LGM with an additional IID random effect indexed only on a selected set of latent field nodes. p. 7
Where the paper says it

INLA-RF2: latent field nodes correction INLA-RF2 uses the RF output to correct a selected subset of latent field nodes. Unlike INLA-RF1, which applies a mean correction through an offset in the linear predictor, INLA-RF2 performs a localized adjustment by augmenting the LGM with an additional IID random effect indexed only on a selected set of indices K (hereafter also referred to as locations or stress nodes), corresponding to the nodes identified for the correction.

Performance Evaluation Metrics

The predictive performance of the INLA-RF algorithms is assessed using several metrics, including Root Mean Square Error (RMSE), Mean Absolute Error (MAE), Coverage Probability (CP), and Average Interval Width (AIW). In simulation studies, INLA-RF1 showed that applying the algorithm without uncertainty propagation resulted in more precise predictions, while including uncertainty propagation led to a wider predictive distribution. p. 8

Where the paper says it

while DKL ≥ δ do STEP 1 (INLA with offset): Compute the updated response y (i) = y − eˆ (i−1) RF . if uncertainty propagation == TRUE then Fit the LGM(A, x, θ) using y (i) as response and including a fixed variance component given by σˆ 2(i−1) RF (OOB-MSE) in the Gaussian likelihood through precoffset.

In the real case study on air pollution data, INLA-RF2 demonstrated clear improvements at stress points where the RMSE decreased substantially from 0. p. 3
Where the paper says it

3 presents the core contribution of the paper, namely the two novel INLA-RF algorithms (INLA-RF1 and INLA-RF2), together with their pseudo-code and implementation details. The empirical evaluation includes two simulation studies and a real case study with air pollution data, discussed in Section 3 and 4, respectively.

93 (INLA) to 0. p. 0
Where the paper says it

INLA-RF: A Hybrid Modeling Strategy for Spatio-Temporal Environmental Data Mario Figueiraa , Michela Camelettib,∗ , Luca Patellib aDepartment of Statistics and Operations Research, University of Valencia, Valencia, Spain bDepartment of Economics, University of Bergamo, Bergamo, Italy Abstract Environmental processes often exhibit complex, non-linear patterns and discontinuities across space and time, posing significant challenges for traditional geostatistical modeling approaches. In this paper, we propose a hybrid modeling strategy that combines the interpretability and principled uncertainty quantification of statistical models with the predictive flexibility of machine learning methods.

22 (INLA-RF2), although this gain was accompanied by a wider interval width. p. 7
Where the paper says it

This means that more uncertain RF corrections are accompanied by a larger observation-level variance contribution, effectively reducing the influence of the offset correction. INLA-RF2: latent field nodes correction INLA-RF2 uses the RF output to correct a selected subset of latent field nodes.

Model Selection and Application

The choice between INLA-RF1 and INLA-RF2 depends on the modeling objective; INLA-RF1 is preferable when the goal is to improve overall predictive performance with minimal additional modeling complexity. In contrast, INLA-RF2 is more suitable when the interest lies in correcting specific regions of the latent field, such as in the presence of structural breaks or localized misspecification. p. 7

Where the paper says it

INLA-RF2: latent field nodes correction INLA-RF2 uses the RF output to correct a selected subset of latent field nodes. Unlike INLA-RF1, which applies a mean correction through an offset in the linear predictor, INLA-RF2 performs a localized adjustment by augmenting the LGM with an additional IID random effect indexed only on a selected set of indices K (hereafter also referred to as locations or stress nodes), corresponding to the nodes identified for the correction.

The empirical results from the Agrimonia dataset indicated that neither seasonal nor yearly components exhibited nodes requiring clear correction, meaning INLA-RF2 did not provide a substantial improvement over the benchmark INLA-based model. p. 7
Where the paper says it

Moreover, the number of observations associated with each node may vary, and different components of the latent field may be candidates for correction. In the INLA-RF2 construction, the RF-based information enters the model through an explicit latent component, thereby enabling a straightforward uncertainty propagation within the INLA framework.

Conclusion and Future Directions

The proposed hybrid approaches can improve predictive accuracy in challenging spatio-temporal settings by combining the strengths of Bayesian modeling and machine learning. INLA-RF1 is recommended when improving overall predictive performance with minimal complexity is desired. p. 0

Where the paper says it

We assess the predictive performance and uncertainty quantification of the INLA-RF algorithms using two simulation studies and a real air pollution application. Overall, the results indicate that INLA-RF can improve spatiotemporal predictive accuracy while retaining interpretability and providing coherent uncertainty estimates.

Future work could investigate automated strategies for selecting the nodes to be corrected in INLA-RF2 and extensions to more complex spatio-temporal settings. The use of a Kullback-Leibler divergence-based stopping criterion provides a principled and efficient way to control the iterative procedure, avoiding unnecessary iterations and reducing the risk of overfitting. p. 3
Where the paper says it

For both INLA-RF algorithms we use the Kullback-Leibler divergence (KLD) as a stopping criterion. This means that the number of iterations of the iterative two-stage scheme is not a tuning parameter but is instead determined by an empirical measure of how much the posterior distribution changes between iterations.

Author Contributions

The authors contributed to the paper as follows: Conceptualization was done by MC, MF, LP. Methodology was provided by MC, MF. p. 3

Where the paper says it

Supplementary material is provided in the appendices: Appendix B presents the predictive performance metrics and the KLD-based stopping criterion, Appendix C reports details about the simulation case studies, while Appendix D contains supplementary results regarding the real case study. Methodology 2.

Code implementation was handled by MF, LP. p. 3
Where the paper says it

2 provides the essential background and notation for INLA-SPDE and RF, limited to the elements required to follow our proposal; additional details are deferred to Appendix A for the readers who are not familiar with these methods. 3 presents the core contribution of the paper, namely the two novel INLA-RF algorithms (INLA-RF1 and INLA-RF2), together with their pseudo-code and implementation details.

Formal data analysis was performed by MF. p. 0
Where the paper says it

INLA-RF: A Hybrid Modeling Strategy for Spatio-Temporal Environmental Data Mario Figueiraa , Michela Camelettib,∗ , Luca Patellib aDepartment of Statistics and Operations Research, University of Valencia, Valencia, Spain bDepartment of Economics, University of Bergamo, Bergamo, Italy Abstract Environmental processes often exhibit complex, non-linear patterns and discontinuities across space and time, posing significant challenges for traditional geostatistical modeling approaches. In this paper, we propose a hybrid modeling strategy that combines the interpretability and principled uncertainty quantification of statistical models with the predictive flexibility of machine learning methods.

Writing - original draft was done by MC, MF, LP. Writing - review & editing was done by MC, MF, LP. Supervision was provided by MC. p. 3
Where the paper says it

Section 5 concludes the paper with a discussion and final remarks. Supplementary material is provided in the appendices: Appendix B presents the predictive performance metrics and the KLD-based stopping criterion, Appendix C reports details about the simulation case studies, while Appendix D contains supplementary results regarding the real case study.

Funding and Availability

The authors acknowledge support from Grant PID2022-136455NB-I00, funded by Ministerio de Ciencia, Innovación y Universidades of Spain (MCIN/AEI/10.13039/501100011033/FEDER, UE) and the European Regional Development Fund. The code for generating the data for the two simulation studies, as well as for implementing the proposed algorithms, is publicly available on GitHub at https://github. p. 3

Where the paper says it

3 presents the core contribution of the paper, namely the two novel INLA-RF algorithms (INLA-RF1 and INLA-RF2), together with their pseudo-code and implementation details. The empirical evaluation includes two simulation studies and a real case study with air pollution data, discussed in Section 3 and 4, respectively.

com/LucaPate/INLA-RF/tree/main. p. 5
Where the paper says it

These quantities are used to assess convergence of the INLA-RF algorithms via the Kullback-Leibler divergence (see Appendix B. RF is an ensemble of regression trees; each tree is fit on a bootstrap resample of the training data (Breiman, 2001).

Declaration of Generative AI

During the preparation of this work the authors used OpenAI (2026) in order to improve the readability and language of the manuscript. The authors reviewed and edited the content as needed and take full responsibility for the content of the published article. p. 7

Where the paper says it

Identifying the stress nodes is the most delicate step of the algorithm. To the authors’ knowledge, there is no single, well-defined criterion for selecting either the number or the location of these nodes.

References

The references listed include works such as Breiman (2001) on Random Forests. Cameletti et al. p. 0

Where the paper says it

Keywords: Hybrid models, INLA, Random Forest, SPDE, Latent Gaussian Models, Uncertainty propagation ∗Corresponding author Email address: michela. cameletti@unibg.

(2013) provided work on spatio-temporal modeling of particulate matter concentration through the SPDE approach. p. 4
Where the paper says it

Moreover, it allows for posterior predictive distributions of the response variable, enabling spatial prediction at any location within the domain of interest. The INLA-SPDE approach is already a powerful and computationally efficient solution for spatio-temporal modeling, providing fast Bayesian inference and principled uncertainty quantification.

Rue and Held (2005) are cited for Gaussian Markov Random Fields. p. 1
Where the paper says it

These models rely on the likelihood function for inference, ensuring a proper quantification of uncertainty. In particular, within a Bayesian framework, the well-established INLA-SPDE approach1 (Rue et al.

Lindgren et al. p. 1
Where the paper says it

In particular, within a Bayesian framework, the well-established INLA-SPDE approach1 (Rue et al. , 2009; Lindgren et al.

(2015) provided work on Bayesian Spatial Modelling with R-INLA. p. 4
Where the paper says it

, 2011b, 2022) as a valid and computationally efficient solution for fast LGM estimation and spatial prediction. In particular, since the INLA-SPDE approach adopts a Bayesian framework, it provides posterior distributions for all unknown parameters, including the spatially and temporally structured random effects, with uncertainty quantification being straightforward.

Breiman (2001) is referenced for Random Forests. p. 2
Where the paper says it

The aim of this paper is to improve the predictive accuracy of spatiotemporal statistical models fitted via the INLA-SPDE approach, while preserving interpretability and uncertainty quantification. To this end, we propose two novel algorithms, collectively denoted as INLA-RF, which couple a parametric spatio-temporal LGM with a well-established ML algorithm as Random Forest (RF, Breiman, 2001).

Green — the paper says it, and the page is printed. Red — no passage carries it, so treat that sentence as unverified. The same check runs on your own text: check a summary against its source, $5.

Improvements for AI systems

  1. Improved predictive accuracy for spatio-temporal data by iteratively coupling a Bayesian spatiotemporal model fitted via INLA-SPDE with Random Forest, allowing it to improve spatiotemporal predictive accuracy while retaining interpretability and providing coherent uncertainty estimates.

  2. Enhanced uncertainty quantification across modeling stages by proposing the explicit propagation of RF predictive uncertainty into the INLA stage, which involves using the INLA precoffset option to include a fixed variance component in the Gaussian likelihood.

  3. Capture of abrupt changes and discontinuities in latent fields through localized adjustment by introducing INLA-RF2, which performs a targeted nodelevel correction of the LGM latent field by augmenting the model with an additional IID random effect indexed only on selected stress nodes.

  4. Computational efficiency and risk reduction through an effective stopping criterion, where the number of iterations is determined by the Kullback-Leibler divergence (KLD) based on how much the posterior distribution changes between iterations.

  5. Model selection strategy flexibility: INLA-RF1 can be used when the goal is to improve overall predictive performance with minimal additional modeling complexity, while INLA-RF2 is more suitable when the interest lies in correcting specific regions of the latent field, for example in the presence of structural breaks or localized misspecification.

Abstract

Environmental processes often exhibit complex, non-linear patterns and discontinuities across space and time, posing significant challenges for traditional geostatistical modeling approaches. In this paper, we propose a hybrid spatio-temporal modeling framework that combines the interpretability and uncertainty quantification of Bayesian models -- estimated using the INLA-SPDE approach -- with the predictive power and flexibility of Random Forest (RF). Specifically, we introduce two novel algorithms, collectively named INLA-RF, which integrate a statistical spatio-temporal model with RF in an iterative two-stage framework. The first algorithm (INLA-RF1) incorporates RF predictions as an offset in the INLA-SPDE model, while the second (INLA-RF2) uses RF to directly correct selected latent field nodes. Both hybrid strategies enable uncertainty propagation between modeling stages, an aspect often overlooked in existing hybrid approaches. In addition, we propose a Kullback-Leibler divergence-based stopping criterion. We evaluate the predictive performance and uncertainty quantification capabilities of the proposed algorithms through two simulation studies. Results suggest that our hybrid approach enhances spatio-temporal prediction while maintaining interpretability and coherence in uncertainty estimates.

Related papers