Scentree: a framework for generating scenario trees for multistage stochastic programming

arXiv:2609.21495 · stat.CO, cs.SE · Submitted 2026-09-18 · Read on arXiv

Listen

Radio episode about this paper

Transcript

Introduction to the show: ident: Statistics. The day in statistics: methods, theory and the inference under them.

Tom: We're looking at the paper: "Scentree: a framework for generating scenario trees for multistage stochastic programming".

Jane: Here's the gist of the paper. Scentree presents an open-source Python package for constructing scenario fans and scenario trees for multistage stochastic programming from historical data because it automates the complete workflow, including model selection, parameter estimation, scenario fan generation, and scenario tree construction.

Tom: Framework Overview Scentree combines machine learning and multivariate time series models to obtain a scenario fan that captures inter-stage dependencies in the stochastic processes.

Jane: This scenario fan is subsequently transformed into a scenario tree suitable for multistage stochastic optimization, providing a flexible and extensible framework for uncertainty modeling.

Tom: A key contribution is the automation of the complete workflow, including model selection, parameter estimation, scenario generation, and tree construction.

Paper summary: Tom: So, wrapping up this discussion on Scentree: a framework for generating scenario trees for multistage stochastic programming. The authors essentially gave us an open-source Python package that automates the whole pipeline from dimensionality reduction and model selection right up to scenario tree construction.

Jane: They showed that you can combine machine learning and time series models to create a scenario fan that handles those inter-stage dependencies, which then becomes a usable scenario tree for multistage optimization problems.

Lu: The main point is the automation of the complete workflow—model selection, parameter estimation, scenario fan generation, and tree construction—and it does this without requiring you to specify assumptions about the underlying data distribution.

Meng: From my side, what matters is that if I can deploy something that takes historical data and spits out a usable structure without me having to be a statistician first, then I see value in testing it on real traffic.

Lalam: Lalam here. What this means for us is that we can build these complex uncertainty representations much faster, and the framework's design allows us to swap out different models or tree construction methods later without breaking the existing system.

Tom: Exactly, so the title Scentree: a framework for generating scenario trees for multistage stochastic programming points to how this tool handles that entire process end-to-end.

Jane: It simplifies uncertainty modeling by taking complex historical data and automatically turning it into a structure suitable for multi-stage decision making under uncertainty.

Lu: The work suggests that we can build better tools for generating these scenarios from real data, which is a key step in moving toward more realistic applications of this kind of stochastic programming.

Conclusion: Tom: So we’ve been looking at Scentree, this open-source Python package that handles everything from picking the right model to building those scenario trees for multistage planning using historical data.

Jane: Right, it automates the whole workflow, which means you don't have to be a statistician just to get a usable tree structure for your optimization problem.

Lu: The authors focus on making this process flexible; they don't assume anything specific about the underlying probability distribution of your data.

Meng: From my side, I'm wondering if this automation means we can actually deploy this reliably without needing someone to manually tune every single hyperparameter for every stage.

Lalam: I see what you mean, Meng; it handles that model selection automatically using cross-validation and then uses a forward tree construction algorithm to build the final structure.

Tom: And the output is a graph of the tree and a json file to save all that data, which is pretty useful for checking things.

Jane: So, what’s actually new about this? It’s not just building trees; it's combining principal component analysis for dimensionality reduction with model families to generate the initial fan.

Lu: The core idea is using machine learning and multivariate time series models together to capture those inter-stage dependencies within the scenario fan itself, which then feeds into a tree construction algorithm.

Meng: I just worry about the complexity of setting up all those predictive model families; if it gets too complex, running it at scale might become a headache.

Lalam: The framework is designed to be agnostic about the specific multistage optimization problem you’re solving, so you can plug in different models or tree construction methods later without rewriting everything.

Tom: It seems like they've built a really accessible tool that takes complex historical data and turns it into a structured uncertainty representation for optimization problems.

Jane: Exactly; it simplifies the hard part of scenario generation by automating the steps that usually require deep statistical knowledge.

Lu: The authors emphasize extensibility, planning to add more advanced machine learning models in the future, like diffusion models, which suggests this is just one piece of a larger picture.

Meng: It's interesting to hear about those future plans; if they can actually integrate things like diffusion models into that framework, that opens up some new avenues for how we model uncertainty.

Tom: So Scentree is positioned as a flexible and accessible starting point for anyone trying to build scenario representations from historical data.

Jane: It’s about taking complex time series data and automatically generating the tools needed for multistage stochastic programming, without you having to define the probability distribution yourself.

Departament d’Estadística i Investigaci₆ Operativa · Universitat Politecnica de Catalunya

stat.CO, cs.SE

Submitted: 2026-09-18

Updated: 2026-11-12

Code: https://github.com/julienkeutchayan/StochOptim

License: http://creativecommons.org/licenses/by-sa/4.0/

Importance score: 72/100

The gist: Scentree presents an open-source Python package for constructing scenario fans and scenario trees for multistage stochastic programming from historical data because it automates the complete…

Key concepts

Scenario Fan
A multi-dimensional representation of possible future states derived from historical data. Scentree uses Principal Component Analysis (PCA) on the data to reduce dimensionality before generating this fan, capturing how different variables change together over time.
Model Selection Process
This involves testing several predictive models against the data using time series cross-validation. The model that minimizes the root mean squared error is automatically chosen from a family of candidate models, ensuring optimal performance for the subsequent scenario generation.
Forward Tree Construction (FTC)
This algorithm sequentially builds a scenario tree from an initial fan. At each stage, it considers scenarios based on which nodes they were assigned in the previous stage and calculates the probability of reaching each node at every point in time.

Terminology

Summary

Scentree presents an open-source Python package for constructing scenario fans and scenario trees for multistage stochastic programming from historical data because it automates the complete workflow, including model selection, parameter estimation, scenario fan generation, and scenario tree construction. p. 1

Where the paper says it

The framework combines multivariate time series and machine learning models to learn the underlying stochastic process and generate scenario fans, which are subsequently transformed into scenario trees. The complete workflow, including model selection, parameter estimation, scenario generation, and tree construction, is automated, reducing the statistical and machine learning expertise required from the user.

Framework Overview

Scentree combines machine learning and multivariate time series models to obtain a scenario fan that captures inter-stage dependencies in the stochastic processes. This scenario fan is subsequently transformed into a scenario tree suitable for multistage stochastic optimization, providing a flexible and extensible framework for uncertainty modeling. p. 0

Where the paper says it

It combines machine learning and multivariate time series models to obtain a scenario fan that captures inter-stage dependencies in the stochastic processes. This scenario fan is subsequently transformed into a scenario tree suitable for multistage stochastic optimization, providing a flexible and extensible framework for uncertainty modeling.

A key contribution is the automation of the complete workflow, including model selection, parameter estimation, scenario generation, and tree construction. p. 0
Where the paper says it

This scenario fan is subsequently transformed into a scenario tree suitable for multistage stochastic optimization, providing a flexible and extensible framework for uncertainty modeling. A key contribution is the automation of the complete workflow, including model selection, parameter estimation, scenario fan generation, and scenario tree construction.

Scentree does not rely on assumptions about the underlying data distribution, reducing the statistical expertise required to produce a scenario tree. p. 0
Where the paper says it

A key contribution is the automation of the complete workflow, including model selection, parameter estimation, scenario fan generation, and scenario tree construction. Scentree does not rely on assumptions about the underlying data distribution, reducing the statistical expertise required to produce a scenario tree.

Furthermore, it is agnostic to the specific multistage stochastic problem to be solved. p. 0
Where the paper says it

Scentree does not rely on assumptions about the underlying data distribution, reducing the statistical expertise required to produce a scenario tree. Furthermore, it is agnostic to the specific multistage stochastic problem to be solved.

Scenario Fan Generation

The first step in generating a scenario fan involves dimensionality reduction using Principal Component Analysis (PCA). After applying PCA to the data, the resulting matrix is of size d × k, and the data are scaled so that the mean and variance of each column are 0 and 1. p. 5

Where the paper says it

data are scaled so that the mean and variance of each column are 0 and 1, respectively. Let X˜ be the resulting matrix.

A set of predictive model families, denoted by Γ, is considered to identify the best-performing model. p. 5
Where the paper says it

Let X˜ be the resulting matrix. Once the data is preprocessed, a set of predictive model families, denoted by Γ, is considered to identify the best-performing model.

Model Selection Process

The selection of the best predictive model involves hyperparameter tuning for each family in Γ. Since the data are indexed by D, time series cross-validation is used to obtain a set of predictive models, denoted by ˜Γ. p. 5

Where the paper says it

Since the data are indexed by D, we use time series cross-validation (Bergmeir and Ben´ıtez 2012). As a result, a set of predictive models, Γ, is obtained.

The final model, f, is selected using the root mean squared error criterion. p. 5
Where the paper says it

Each model in ˜ Γ is the best-performing ˜ model within its respective family. Afterwards, the final model, f, is selected using the root mean squared error: f := arg min g∈Γ˜ 1 d − h d X−h i=1 r 1 k g(x˜i , x˜i+1, .

This selection process ensures that the chosen model performs optimally within its respective family. p. 5
Where the paper says it

As a result, a set of predictive models, Γ, is obtained. Each model in ˜ Γ is the best-performing ˜ model within its respective family.

Scenario Tree Construction

The scenario tree construction utilizes the forward tree construction algorithm (FTC) to construct a scenario tree from an initial scenario fan by proceeding sequentially through the stages. At each stage, scenarios are considered according to the nodes to which they were assigned in the previous stage. p. 7

Where the paper says it

scenario fan by proceeding sequentially through the stages. At each stage, the scenarios are considered according to the nodes to which they were assigned in the previous stage.

The FTC algorithm also computes the probability of each node at each stage throughout the scenarios. p. 7
Where the paper says it

These values are given by the scenario selected as the representative of that node. The FTC algorithm also computes the probability of each node at each stage throughout the scenarios.

The framework implements this FTC algorithm to construct scenario trees for each of the nf scenario fans obtained. p. 7
Where the paper says it

Our framework implements the FTC algorithm to construct the scenario trees. For each of the nf scenario fans, a corresponding scenario tree is obtained.

Output and Flexibility

The output structure provides several relevant data, including a graph representing the scenario tree and an exporter module that saves all output data in a json file. The design is agnostic to the underlying algorithm, allowing alternative tree construction methods to be implemented without affecting existing ones. p. 7

Where the paper says it

(2020), and Li and Gao (2019). Consequently, the tree modeling design adopted in scentree is agnostic to the underlying algorithm, allowing alternative tree construction methods to be implemented without affecting the existing ones.

Extensions are planned for future research, such as incorporating additional machine learning and deep learning models like diffusion models. p. 0
Where the paper says it

Javier Heredia Departament d’Estad´ıstica i Investigaci´o Operativa Universitat Polit`ecnica de Catalunya September 2026 Abstract We present scentree, an open-source Python package for constructing a scenario fan and a scenario tree for multistage stochastic programming from historical data. It combines machine learning and multivariate time series models to obtain a scenario fan that captures inter-stage dependencies in the stochastic processes.

The framework is intended to provide a flexible and accessible framework for scenario generation while maintaining sufficient extensibility. p. 2
Where the paper says it

Built on top of JuMP (Dunning, Huchette, and Lubin 2017), it provides a high-level modeling interface while maintaining performance comparable to low-level implementations. Its main contribution is the development of a flexible, solver-independent, and extensible implementation of SDDP.

Illustrative Example

An illustrative example considers a three-stage problem with dimensions p1 = 6, p2 = 15, and p3 = 14, resulting in a total dimension of p = 35. Two different datasets, X1 and X2, are used as simulated observations from a Brownian motion with a trend. p. 8

Where the paper says it

Two different datasets, represented by X1 and X2, are used. Both of them consisting of observations from a Brownian motion with a trend (BMT for short).

The package allows each dataset to be loaded individually with the corresponding mapping specified. p. 9
Where the paper says it

Although Python uses zero-based indexing, we use one-based indexing when referring to matrix columns/rows throughout this example. Our framework allows each dataset to be loaded individually, with the corresponding mapping specified as illustrated in Listing 4.

The final step involves constructing the scenario tree from the generated scenario fan data F. p. 7
Where the paper says it

This procedure is repeated until the final stage, resulting in the complete scenario tree. Given a scenario fan, the resulting scenario tree can be represented, in terms of data, by a matrix of size ns × p.

Conclusion

Overall, scentree is intended to provide a flexible and accessible framework for scenario generation while maintaining sufficient extensibility to accommodate future developments in predictive modeling and scenario tree construction. The work presents scentree, an open-source Python package for generating scenario fans and scenario trees for multistage stochastic programming using historical data. p. 0

Where the paper says it

Scentree: a framework for generating scenario trees for multistage stochastic programming Cristian Pach´on-Garc´ıa, Albert Sol`a Vilalta and F-. Javier Heredia Departament d’Estad´ıstica i Investigaci´o Operativa Universitat Polit`ecnica de Catalunya September 2026 Abstract We present scentree, an open-source Python package for constructing a scenario fan and a scenario tree for multistage stochastic programming from historical data.

This framework automates the main steps of generation process, from dimensionality reduction and model selection to scenario fan generation and scenario tree construction. p. 0
Where the paper says it

This scenario fan is subsequently transformed into a scenario tree suitable for multistage stochastic optimization, providing a flexible and extensible framework for uncertainty modeling. A key contribution is the automation of the complete workflow, including model selection, parameter estimation, scenario fan generation, and scenario tree construction.

A key feature of scentree is its accessibility, as it does not require the user to specify a probability distribution for the underlying stochastic process. p. 1
Where the paper says it

A scenario representation should capture the main characteristics of the underlying stochastic process. When historical observations of the uncertain process are available, scenario generation can be approached directly from data rather than by assuming a predefined probability distribution.

The selection of predictive models are performed automatically. p. 1
Where the paper says it

The framework combines multivariate time series and machine learning models to learn the underlying stochastic process and generate scenario fans, which are subsequently transformed into scenario trees. The complete workflow, including model selection, parameter estimation, scenario generation, and tree construction, is automated, reducing the statistical and machine learning expertise required from the user.

The framework remains flexible: its design is agnostic to the particular predictive model or tree construction method allowing new models and scenario tree construction or clustering methods to be incorporated without affecting existing implementations. p. 7
Where the paper says it

Consequently, the tree modeling design adopted in scentree is agnostic to the underlying algorithm, allowing alternative tree construction methods to be implemented without affecting the existing ones. The choice of the method will be therefore left to the user.

Acknowledgments

This work has been supported with grants PID2022-139219OB-I00 and CetpFP-2023-00185 from the Spanish Ministerio de Ciencia, Innovaci´on y Universidades. This research has been funded by CETPartnership, the Clean Energy Transition Partnership under the 2023 joint call for research proposals, co-funded by the European Commission (GA N°101069750) and with the funding organisations FFG (Austria), AEI (Spain) and MUR (Italy).

References

Bellman, Richard E. (1957). Dynamic Programming. p. 2

Where the paper says it

Regarding the scenario creation process, the framework does not include methods for generating scenarios from historical data, as it relies on usersupplied scenarios or on a user-defined sampling mechanism representing the underlying stochastic process. jl (Dowson and Kapelevich 2021) is an open-source Julia package for solving large multistage stochastic optimization problems using the Stochastic Dual Dynamic Programming (SDDP) algorithm (Philpott, Matos, and Finardi 2013).

Princeton University Press. Bergmeir, Christoph and Jos´e M. p. 5
Where the paper says it

In order to select the best model for each family in Γ, the first step consists of hyperparameter tuning. Since the data are indexed by D, we use time series cross-validation (Bergmeir and Ben´ıtez 2012).

Ben´ıtez (2012). p. 5
Where the paper says it

In order to select the best model for each family in Γ, the first step consists of hyperparameter tuning. Since the data are indexed by D, we use time series cross-validation (Bergmeir and Ben´ıtez 2012).

“On the use of crossvalidation for time series predictor evaluation”. p. 5
Where the paper says it

In order to select the best model for each family in Γ, the first step consists of hyperparameter tuning. Since the data are indexed by D, we use time series cross-validation (Bergmeir and Ben´ıtez 2012).

In: Information Sciences 191, pp. p. 0
Where the paper says it

Keywords: scenario fan, scenario tree reduction, machine learning, multivariate time series models, multistage stochastic programming, uncertainty estimation. 1 Introduction Uncertainty arises in a natural way in many situations where decision must be made before all relevant information in available.

192–213. Bezanson, Jeff, Alan Edelman, Stefan Karpinski, and Viral B. p. 2
Where the paper says it

, an already trained machine learning model), which requires the user to have prior knowledge of the underlying stochastic process. Recent advances in optimization software have established Julia (Bezanson et al.

Shah (2017). p. 2
Where the paper says it

Recent advances in optimization software have established Julia (Bezanson et al. 2017) as a suitable programming language for mathematical programming.

“Julia. A fresh approach to numerical computing”. p. 1
Where the paper says it

When historical observations of the uncertain process are available, scenario generation can be approached directly from data rather than by assuming a predefined probability distribution. This approach is particularly relevant when the underlying process is multivariate or exhibits complex temporal dependencies.

In: SIAM review 59. p. 3
Where the paper says it

As a result, dependencies among the components of multivariate random vectors cannot be modeled, preventing the direct generation of multivariate scenario trees from data. The final package considered in this review is StochOptim, which is available at https://github.

p. 3
Where the paper says it

As a result, dependencies among the components of multivariate random vectors cannot be modeled, preventing the direct generation of multivariate scenario trees from data. The final package considered in this review is StochOptim, which is available at https://github.

1, pp. 65–98. Biel, Martin and Mikael Johansson (2022). p. 2
Where the paper says it

2017) as a suitable programming language for mathematical programming. Biel and Johansson 2022 present StochasticPrograms.

“Efficient Stochastic Programming in Julia”. p. 2
Where the paper says it

Biel and Johansson 2022 present StochasticPrograms. jl, an open-source framework for modeling and solving stochastic programming problems in Julia.

In: Informs Journal on Computing 34.4, pp. 1885–1902. Birge, John R. p. 0
Where the paper says it

In these and many other applications, uncertain quantities evolve over time, and new information becomes available as the decision-making process progresses. Multistage stochastic programming (Birge and Louveaux 2011) provides a mathematical framework for addressing this type of decision problem by explicitly incorporating the evolution of uncertain parameters across multiple stages.

and Fran¸cois Louveaux (2011). p. 0
Where the paper says it

In these and many other applications, uncertain quantities evolve over time, and new information becomes available as the decision-making process progresses. Multistage stochastic programming (Birge and Louveaux 2011) provides a mathematical framework for addressing this type of decision problem by explicitly incorporating the evolution of uncertain parameters across multiple stages.

Introduction to Stochastic Programming. p. 0
Where the paper says it

Keywords: scenario fan, scenario tree reduction, machine learning, multivariate time series models, multistage stochastic programming, uncertainty estimation. 1 Introduction Uncertainty arises in a natural way in many situations where decision must be made before all relevant information in available.

Springer Nature. p. 5
Where the paper says it

Essentially, to obtain a scenario fan, we apply a Monte Carlo method (Hammersley and Handscomb 1964). Due to the nature of PCA, the reduced data can be mapped back to the original p-dimensional space.

p. 5
Where the paper says it

Essentially, to obtain a scenario fan, we apply a Monte Carlo method (Hammersley and Handscomb 1964). Due to the nature of PCA, the reduced data can be mapped back to the original p-dimensional space.

Cortes, Corinna and Vladimir Vapnik (1995). p. 5
Where the paper says it

Once the data is preprocessed, a set of predictive model families, denoted by Γ, is considered to identify the best-performing model. The families in Γ include multivariate time series models, such as vector autoregressive models (Sims 1980), and machine learning models, including support vector machines (Cortes and Vapnik 1995).

“Support-Vector Networks”. p. 5
Where the paper says it

Once the data is preprocessed, a set of predictive model families, denoted by Γ, is considered to identify the best-performing model. The families in Γ include multivariate time series models, such as vector autoregressive models (Sims 1980), and machine learning models, including support vector machines (Cortes and Vapnik 1995).

In: Machine Learning 20, pp. p. 0
Where the paper says it

Javier Heredia Departament d’Estad´ıstica i Investigaci´o Operativa Universitat Polit`ecnica de Catalunya September 2026 Abstract We present scentree, an open-source Python package for constructing a scenario fan and a scenario tree for multistage stochastic programming from historical data. It combines machine learning and multivariate time series models to obtain a scenario fan that captures inter-stage dependencies in the stochastic processes.

273–297. Cuadrado-Guevara, Marlyn Dayana (2020). p. 3
Where the paper says it

To address this challenge, we developed scentree, an open-source Python package that automates the complete scenario generation workflow from historical data. The framework is inspired by Heredia, Cuadrado, and Corchero (2018) and Cuadrado-Guevara (2020), who propose the idea of constructing scenario fans using time series factor analysis (TSFA for short; Gilber and Meijer 2005).

“Multistage scenario trees generation for renewable energy systems optimization”. p. 3
Where the paper says it

The framework is inspired by Heredia, Cuadrado, and Corchero (2018) and Cuadrado-Guevara (2020), who propose the idea of constructing scenario fans using time series factor analysis (TSFA for short; Gilber and Meijer 2005). These works focus on modeling uncertainty associated with renewable energy systems through a multistage stochastic programming framework.

PhD’s thesis. Universitat Politica de Catalunya. p. 0
Where the paper says it

Scentree: a framework for generating scenario trees for multistage stochastic programming Cristian Pach´on-Garc´ıa, Albert Sol`a Vilalta and F-. Javier Heredia Departament d’Estad´ıstica i Investigaci´o Operativa Universitat Polit`ecnica de Catalunya September 2026 Abstract We present scentree, an open-source Python package for constructing a scenario fan and a scenario tree for multistage stochastic programming from historical data.

Dowson, Oscar and Lea Kapelevich (2021). p. 2
Where the paper says it

Regarding the scenario creation process, the framework does not include methods for generating scenarios from historical data, as it relies on usersupplied scenarios or on a user-defined sampling mechanism representing the underlying stochastic process. jl (Dowson and Kapelevich 2021) is an open-source Julia package for solving large multistage stochastic optimization problems using the Stochastic Dual Dynamic Programming (SDDP) algorithm (Philpott, Matos, and Finardi 2013).

“SDDP.jl. a Julia package for stochastic dual dynamic programming”. p. 2
Where the paper says it

Regarding the scenario creation process, the framework does not include methods for generating scenarios from historical data, as it relies on usersupplied scenarios or on a user-defined sampling mechanism representing the underlying stochastic process. jl (Dowson and Kapelevich 2021) is an open-source Julia package for solving large multistage stochastic optimization problems using the Stochastic Dual Dynamic Programming (SDDP) algorithm (Philpott, Matos, and Finardi 2013).

In: Informs Journal on Computing 33.1, pp. 27–33. Dunning, Iain, Joey Huchette, and Miles Lubin (2017). p. 2
Where the paper says it

jl (Dowson and Kapelevich 2021) is an open-source Julia package for solving large multistage stochastic optimization problems using the Stochastic Dual Dynamic Programming (SDDP) algorithm (Philpott, Matos, and Finardi 2013). Built on top of JuMP (Dunning, Huchette, and Lubin 2017), it provides a high-level modeling interface while maintaining performance comparable to low-level implementations.

“JuMP. A Modeling Language for Mathematical Optimization”. p. 2
Where the paper says it

Recent advances in optimization software have established Julia (Bezanson et al. 2017) as a suitable programming language for mathematical programming.

In: SIAM review 59.2, pp. 295–320. Dunteman, George H. p. 4
Where the paper says it

1 Scenario fan generation As the dimension of the stochastic process, p, could be so large as to incur the curse of dimensionality (Bellman 1957), the first step is to reduce the dimensionality by means of Principal Component Analysis (PCA for short; Pearson 1901). The number of principal components is selected such that at least 80% of the total variance is explained, following a commonly used variance-retention criterion (Dunteman 1989).

(1989). Principal Components Analysis. p. 4
Where the paper says it

1 Scenario fan generation As the dimension of the stochastic process, p, could be so large as to incur the curse of dimensionality (Bellman 1957), the first step is to reduce the dimensionality by means of Principal Component Analysis (PCA for short; Pearson 1901). The number of principal components is selected such that at least 80% of the total variance is explained, following a commonly used variance-retention criterion (Dunteman 1989).

SAGE Publications. Dupaˇcov´a, Jitka, Giorgio Consigli, and Stein W. p. 1
Where the paper says it

Consequently, a discrete approximation of the stochastic process is required. Such an approximation can be represented by a finite collection of scenarios (Dupaˇcov´a, Consigli, and Wallace 2000), where each scenario corresponds to one possible realization of the stochastic process over the planning horizon.

Wallace (2000). p. 1
Where the paper says it

Consequently, a discrete approximation of the stochastic process is required. Such an approximation can be represented by a finite collection of scenarios (Dupaˇcov´a, Consigli, and Wallace 2000), where each scenario corresponds to one possible realization of the stochastic process over the planning horizon.

“Scenarios for Multistage Stochastic Programs”. p. 1
Where the paper says it

Such an approximation can be represented by a finite collection of scenarios (Dupaˇcov´a, Consigli, and Wallace 2000), where each scenario corresponds to one possible realization of the stochastic process over the planning horizon. For multistage problems, scenarios must account for the underlying structure of the uncertain process, which is typically described over a parameterized space, denoted by D in this work, often with time as the parameter.

In: Annals of Operations Research 100, pp. p. 2
Where the paper says it

Section 3 provides a detailed description of the scentree package, together with an illustrative example in Section 4. Finally, Section 5 presents the conclusions and discusses potential directions for future research.

25–53. Gilber, Paul D. p. 3
Where the paper says it

To address this challenge, we developed scentree, an open-source Python package that automates the complete scenario generation workflow from historical data. The framework is inspired by Heredia, Cuadrado, and Corchero (2018) and Cuadrado-Guevara (2020), who propose the idea of constructing scenario fans using time series factor analysis (TSFA for short; Gilber and Meijer 2005).

and Erik Meijer (2005). p. 3
Where the paper says it

To address this challenge, we developed scentree, an open-source Python package that automates the complete scenario generation workflow from historical data. The framework is inspired by Heredia, Cuadrado, and Corchero (2018) and Cuadrado-Guevara (2020), who propose the idea of constructing scenario fans using time series factor analysis (TSFA for short; Gilber and Meijer 2005).

Time Series Factor Analysis with an Application to Measuring Money. p. 3
Where the paper says it

To address this challenge, we developed scentree, an open-source Python package that automates the complete scenario generation workflow from historical data. The framework is inspired by Heredia, Cuadrado, and Corchero (2018) and Cuadrado-Guevara (2020), who propose the idea of constructing scenario fans using time series factor analysis (TSFA for short; Gilber and Meijer 2005).

Tech. rep. University of Groningen, Research Institute SOM (Systems, Organisations and Management). p. 3
Where the paper says it

The framework is inspired by Heredia, Cuadrado, and Corchero (2018) and Cuadrado-Guevara (2020), who propose the idea of constructing scenario fans using time series factor analysis (TSFA for short; Gilber and Meijer 2005). These works focus on modeling uncertainty associated with renewable energy systems through a multistage stochastic programming framework.

Hammersley, John M. p. 5
Where the paper says it

Note that the output is a tensor F˜ of size nf × ns × k or, equivalently, a vector of length nf whose entries are matrices of size ns × k. Essentially, to obtain a scenario fan, we apply a Monte Carlo method (Hammersley and Handscomb 1964).

and David C. Handscomb (1964). p. 5
Where the paper says it

Note that the output is a tensor F˜ of size nf × ns × k or, equivalently, a vector of length nf whose entries are matrices of size ns × k. Essentially, to obtain a scenario fan, we apply a Monte Carlo method (Hammersley and Handscomb 1964).

Monte Carlo Methods. p. 5
Where the paper says it

Note that the output is a tensor F˜ of size nf × ns × k or, equivalently, a vector of length nf whose entries are matrices of size ns × k. Essentially, to obtain a scenario fan, we apply a Monte Carlo method (Hammersley and Handscomb 1964).

Springer Nature. Hart, William E. p. 2
Where the paper says it

(2023) presents mpi-sppy, a Python package (Python Software Foundation 2026) whose main feature is its efficient parallelization capabilities. The framework is integrated with Pyomo (Hart, Watson, and Woodruff 2011), allowing users to take advantage of the full range of functionalities provided by Pyomo.

, Jean-Paul Watson, and David L. p. 2
Where the paper says it

(2023) presents mpi-sppy, a Python package (Python Software Foundation 2026) whose main feature is its efficient parallelization capabilities. The framework is integrated with Pyomo (Hart, Watson, and Woodruff 2011), allowing users to take advantage of the full range of functionalities provided by Pyomo.

Woodruff (2011). p. 2
Where the paper says it

(2023) presents mpi-sppy, a Python package (Python Software Foundation 2026) whose main feature is its efficient parallelization capabilities. The framework is integrated with Pyomo (Hart, Watson, and Woodruff 2011), allowing users to take advantage of the full range of functionalities provided by Pyomo.

“Pyomo. modeling and solving mathematical programs in Python”. p. 2
Where the paper says it

Biel and Johansson 2022 present StochasticPrograms. jl, an open-source framework for modeling and solving stochastic programming problems in Julia.

In: Mathematical Programming Computation 3, pp. p. 0
Where the paper says it

In these and many other applications, uncertain quantities evolve over time, and new information becomes available as the decision-making process progresses. Multistage stochastic programming (Birge and Louveaux 2011) provides a mathematical framework for addressing this type of decision problem by explicitly incorporating the evolution of uncertain parameters across multiple stages.

219–260. Heitsch, Holger and Werner R¨omisch (2009). p. 6
Where the paper says it

Thus, when solving the optimization problem, a discrete process ξtr approximating ξ must be considered (Shapiro, Dentcheva, and Ruszczy´nski 2009). Heitsch and R¨omisch (2009) propose a practical approach to construct ξtr.

“Scenario tree modeling for multistage stochastic programs”. p. 0
Where the paper says it

It combines machine learning and multivariate time series models to obtain a scenario fan that captures inter-stage dependencies in the stochastic processes. This scenario fan is subsequently transformed into a scenario tree suitable for multistage stochastic optimization, providing a flexible and extensible framework for uncertainty modeling.

In: Mathematical Programming 118, pp. p. 0
Where the paper says it

In these and many other applications, uncertain quantities evolve over time, and new information becomes available as the decision-making process progresses. Multistage stochastic programming (Birge and Louveaux 2011) provides a mathematical framework for addressing this type of decision problem by explicitly incorporating the evolution of uncertain parameters across multiple stages.

71–406. Heredia, F. p. 0
Where the paper says it

Scentree: a framework for generating scenario trees for multistage stochastic programming Cristian Pach´on-Garc´ıa, Albert Sol`a Vilalta and F-. Javier Heredia Departament d’Estad´ıstica i Investigaci´o Operativa Universitat Polit`ecnica de Catalunya September 2026 Abstract We present scentree, an open-source Python package for constructing a scenario fan and a scenario tree for multistage stochastic programming from historical data.

-Javier, Marlyn D. p. 0
Where the paper says it

Scentree: a framework for generating scenario trees for multistage stochastic programming Cristian Pach´on-Garc´ıa, Albert Sol`a Vilalta and F-. Javier Heredia Departament d’Estad´ıstica i Investigaci´o Operativa Universitat Polit`ecnica de Catalunya September 2026 Abstract We present scentree, an open-source Python package for constructing a scenario fan and a scenario tree for multistage stochastic programming from historical data.

Cuadrado, and Cristina Corchero (2018). p. 3
Where the paper says it

To address this challenge, we developed scentree, an open-source Python package that automates the complete scenario generation workflow from historical data. The framework is inspired by Heredia, Cuadrado, and Corchero (2018) and Cuadrado-Guevara (2020), who propose the idea of constructing scenario fans using time series factor analysis (TSFA for short; Gilber and Meijer 2005).

“On optimal participation in the electricity markets of wind power plants with battery energy storage systems”. p. 3
Where the paper says it

The authors use TSFA to (1) reduce the dimensionality of the data, (2) estimate the underlying stochastic process, and (3) predict future values, with the ultimate goal of supporting participation in the electricity market. Similarly, Sol`a Vilalta, Bosch, and Heredia (2025) apply the same methodology to construct an optimal bid curve for participation in the Spanish electricity markets.

In: Computers & Operations Research 96, pp. p. 2
Where the paper says it

Section 3 provides a detailed description of the scentree package, together with an illustrative example in Section 4. Finally, Section 5 presents the conclusions and discusses potential directions for future research.

316–329. Hewitt, Mike, Janosch Ortmann, and Walter Rei (2022). p. 7
Where the paper says it

Although FTC is one of the earliest algorithms proposed, considerable research has been devoted to this topic. Examples include Hewitt, Ortmann, and Rei (2022), Medina-Gonz´alez et al.

“Decision-based scenario clustering for decision-making under uncertainty”. p. 0
Where the paper says it

Similarly, in financial planning, investment decisions are made under uncertainty about future market conditions. In these and many other applications, uncertain quantities evolve over time, and new information becomes available as the decision-making process progresses.

In: Annals of Operations Research 315, pp. p. 2
Where the paper says it

Section 3 provides a detailed description of the scentree package, together with an illustrative example in Section 4. Finally, Section 5 presents the conclusions and discusses potential directions for future research.

747–771. Hyndman, Rob J. p. 6
Where the paper says it

Note that the index set D remains unchanged. This approach is also exploited by Hyndman and Shang (2009), who forecast the principal component scores of functional observations as time series.

and Han Lin Shang (2009). p. 6
Where the paper says it

Note that the index set D remains unchanged. This approach is also exploited by Hyndman and Shang (2009), who forecast the principal component scores of functional observations as time series.

“Forecasting functional time series”. p. 6
Where the paper says it

Note that the index set D remains unchanged. This approach is also exploited by Hyndman and Shang (2009), who forecast the principal component scores of functional observations as time series.

In: Journal of the Korean Statistical Society 38. p. 0
Where the paper says it

A key contribution is the automation of the complete workflow, including model selection, parameter estimation, scenario fan generation, and scenario tree construction. Scentree does not rely on assumptions about the underlying data distribution, reducing the statistical expertise required to produce a scenario tree.

3, pp. 199–211. Kirui, Kipngeno Benard, Alois Pichler, and Georg Ch. p. 3
Where the paper says it

stochastic program and does not provide methods for generating scenarios from historical data. Kirui, Pichler, and Pflug (2020) present ScenTrees.

Pflug (2020). p. 3
Where the paper says it

stochastic program and does not provide methods for generating scenarios from historical data. Kirui, Pichler, and Pflug (2020) present ScenTrees.

“ScenTrees. p. 3
Where the paper says it

stochastic program and does not provide methods for generating scenarios from historical data. Kirui, Pichler, and Pflug (2020) present ScenTrees.

jl. A Julia Package for Generating Scenario Trees and Scenario Lattices for Multistage Stochastic Programming”. p. 2
Where the paper says it

Regarding the scenario creation process, the framework does not include methods for generating scenarios from historical data, as it relies on usersupplied scenarios or on a user-defined sampling mechanism representing the underlying stochastic process. jl (Dowson and Kapelevich 2021) is an open-source Julia package for solving large multistage stochastic optimization problems using the Stochastic Dual Dynamic Programming (SDDP) algorithm (Philpott, Matos, and Finardi 2013).

In: Journal of Open Source Software 5. p. 0
Where the paper says it

Scentree: a framework for generating scenario trees for multistage stochastic programming Cristian Pach´on-Garc´ıa, Albert Sol`a Vilalta and F-. Javier Heredia Departament d’Estad´ıstica i Investigaci´o Operativa Universitat Polit`ecnica de Catalunya September 2026 Abstract We present scentree, an open-source Python package for constructing a scenario fan and a scenario tree for multistage stochastic programming from historical data.

46, 1912. Knueven, Bernard, David Mildebrath, Christopher Muir, John D. p. 2
Where the paper says it

2 Background The literature on software for stochastic programming is extensive. The work of Knueven et al.

Siirola, Jean-Paul Watson, and David L. p. 2
Where the paper says it

(2023) presents mpi-sppy, a Python package (Python Software Foundation 2026) whose main feature is its efficient parallelization capabilities. The framework is integrated with Pyomo (Hart, Watson, and Woodruff 2011), allowing users to take advantage of the full range of functionalities provided by Pyomo.

Woodruff (2023). p. 2
Where the paper says it

(2023) presents mpi-sppy, a Python package (Python Software Foundation 2026) whose main feature is its efficient parallelization capabilities. The framework is integrated with Pyomo (Hart, Watson, and Woodruff 2011), allowing users to take advantage of the full range of functionalities provided by Pyomo.

“A parallel hub-andspoke system for large-scale scenario-based optimization under uncertainty”. p. 2
Where the paper says it

The package provides an expressive modeling language, distributed-memory support for large-scale instances, and parallel implementations of structure-exploiting algorithms, such as variants of the Lshaped. Regarding the scenario creation process, the framework does not include methods for generating scenarios from historical data, as it relies on usersupplied scenarios or on a user-defined sampling mechanism representing the underlying stochastic process.

In: Mathematical Programming Computation 15, pp. p. 0
Where the paper says it

In these and many other applications, uncertain quantities evolve over time, and new information becomes available as the decision-making process progresses. Multistage stochastic programming (Birge and Louveaux 2011) provides a mathematical framework for addressing this type of decision problem by explicitly incorporating the evolution of uncertain parameters across multiple stages.

591–619. Li, Qiao and David Wenzhong Gao (2019). p. 7
Where the paper says it

Examples include Hewitt, Ortmann, and Rei (2022), Medina-Gonz´alez et al. (2020), and Li and Gao (2019).

“Fast Scenario Reduction for Power Systems by Deep Learning”. p. 0
Where the paper says it

Furthermore, it is agnostic to the specific multistage stochastic problem to be solved. Keywords: scenario fan, scenario tree reduction, machine learning, multivariate time series models, multistage stochastic programming, uncertainty estimation.

arXiv: 1908. p. 0
Where the paper says it

Multistage stochastic programming (Birge and Louveaux 2011) provides a mathematical framework for addressing this type of decision problem by explicitly incorporating the evolution of uncertain parameters across multiple stages. At each stage, decisions can be adjusted according to the 1 arXiv:2609.

11486. Medina-Gonz´alez, Sergio, Ioannis Gkioulekas, Vivek Dua, and Lazaros G. p. 7
Where the paper says it

Although FTC is one of the earliest algorithms proposed, considerable research has been devoted to this topic. Examples include Hewitt, Ortmann, and Rei (2022), Medina-Gonz´alez et al.

Papageorgiou (2020). p. 3
Where the paper says it

stochastic program and does not provide methods for generating scenarios from historical data. Kirui, Pichler, and Pflug (2020) present ScenTrees.

“A graph theory approach for scenario aggregation for stochastic optimisation”. p. 1
Where the paper says it

In addition, the framework is agnostic to the specific multistage stochastic problem to be solved and facilitates scenario generation. To the best of our knowledge, this is the first Python framework that addresses scenario fan construction and scenario tree modeling using a machine learning approach.

In: Computers & Chemical Engineering 137, 106810. Pearson, Karl (1901). p. 4
Where the paper says it

readthedocs. 1 Scenario fan generation As the dimension of the stochastic process, p, could be so large as to incur the curse of dimensionality (Bellman 1957), the first step is to reduce the dimensionality by means of Principal Component Analysis (PCA for short; Pearson 1901).

“On lines and planes of closest fit to systems of points in space”. In: The London, Edinburgh, and Dublin Philosophical Magazine and Journal of Science 2.11, pp. 559–572. Pedregosa, Fabian et al. p. 6
Where the paper says it

Let F be the tensor of size nf × ns × p containing the p-dimensional scenario fans which has been obtained from F˜. It is worth mentioning that we use scikit-learn (Pedregosa et al.

(2011). “Scikit-learn. p. 6
Where the paper says it

Let F be the tensor of size nf × ns × p containing the p-dimensional scenario fans which has been obtained from F˜. It is worth mentioning that we use scikit-learn (Pedregosa et al.

Machine Learning in Python”. p. 0
Where the paper says it

Javier Heredia Departament d’Estad´ıstica i Investigaci´o Operativa Universitat Polit`ecnica de Catalunya September 2026 Abstract We present scentree, an open-source Python package for constructing a scenario fan and a scenario tree for multistage stochastic programming from historical data. It combines machine learning and multivariate time series models to obtain a scenario fan that captures inter-stage dependencies in the stochastic processes.

In: Journal of Machine Learning Research 12. p. 0
Where the paper says it

Javier Heredia Departament d’Estad´ıstica i Investigaci´o Operativa Universitat Polit`ecnica de Catalunya September 2026 Abstract We present scentree, an open-source Python package for constructing a scenario fan and a scenario tree for multistage stochastic programming from historical data. It combines machine learning and multivariate time series models to obtain a scenario fan that captures inter-stage dependencies in the stochastic processes.

85, pp. 2825–2830. Philpott, Andy et al. p. 2
Where the paper says it

Regarding the scenario creation process, the framework does not include methods for generating scenarios from historical data, as it relies on usersupplied scenarios or on a user-defined sampling mechanism representing the underlying stochastic process. jl (Dowson and Kapelevich 2021) is an open-source Julia package for solving large multistage stochastic optimization problems using the Stochastic Dual Dynamic Programming (SDDP) algorithm (Philpott, Matos, and Finardi 2013).

(2013). “On Solving Multistage Stochastic Programs with Coherent Risk Measures”. p. 2
Where the paper says it

Regarding the scenario creation process, the framework does not include methods for generating scenarios from historical data, as it relies on usersupplied scenarios or on a user-defined sampling mechanism representing the underlying stochastic process. jl (Dowson and Kapelevich 2021) is an open-source Julia package for solving large multistage stochastic optimization problems using the Stochastic Dual Dynamic Programming (SDDP) algorithm (Philpott, Matos, and Finardi 2013).

In: Informs Journal on Computing 61.4, pp. 957–970. Python Software Foundation (2026). p. 2
Where the paper says it

The work of Knueven et al. (2023) presents mpi-sppy, a Python package (Python Software Foundation 2026) whose main feature is its efficient parallelization capabilities.

Python Programming Language. p. 2
Where the paper says it

Recent advances in optimization software have established Julia (Bezanson et al. 2017) as a suitable programming language for mathematical programming.

Seabold and Perktold (2019). p. 6
Where the paper says it

It is worth mentioning that we use scikit-learn (Pedregosa et al. 2011) as well as statsmodels (Seabold and Perktold 2019) to incorporate predictive models.

“statsmodels. p. 6
Where the paper says it

It is worth mentioning that we use scikit-learn (Pedregosa et al. 2011) as well as statsmodels (Seabold and Perktold 2019) to incorporate predictive models.

Econometric and statistical modeling with python”. p. 3
Where the paper says it

However, constructing representative scenarios often requires substantial statistical expertise. To address this challenge, we developed scentree, an open-source Python package that automates the complete scenario generation workflow from historical data.

In: 9th Python in Science Conference, pp. p. 0
Where the paper says it

Scentree: a framework for generating scenario trees for multistage stochastic programming Cristian Pach´on-Garc´ıa, Albert Sol`a Vilalta and F-. Javier Heredia Departament d’Estad´ıstica i Investigaci´o Operativa Universitat Polit`ecnica de Catalunya September 2026 Abstract We present scentree, an open-source Python package for constructing a scenario fan and a scenario tree for multistage stochastic programming from historical data.

92–96. Shapiro, Alexander et al. p. 6
Where the paper says it

2 Scenario tree modeling A key aspect of multistage stochastic programming is the need to consider a discrete approximation of the stochastic process. Thus, when solving the optimization problem, a discrete process ξtr approximating ξ must be considered (Shapiro, Dentcheva, and Ruszczy´nski 2009).

(2009). Lectures on Stochastic Programming. p. 0
Where the paper says it

Scentree: a framework for generating scenario trees for multistage stochastic programming Cristian Pach´on-Garc´ıa, Albert Sol`a Vilalta and F-. Javier Heredia Departament d’Estad´ıstica i Investigaci´o Operativa Universitat Polit`ecnica de Catalunya September 2026 Abstract We present scentree, an open-source Python package for constructing a scenario fan and a scenario tree for multistage stochastic programming from historical data.

Modeling and Theory. p. 0
Where the paper says it

It combines machine learning and multivariate time series models to obtain a scenario fan that captures inter-stage dependencies in the stochastic processes. This scenario fan is subsequently transformed into a scenario tree suitable for multistage stochastic optimization, providing a flexible and extensible framework for uncertainty modeling.

SIAM. Silverman, Bernard W. p. 3
Where the paper says it

jl, the first Julia package dedicated to scenario generation for stochastic programming. Scenario generation can be based either on a user-defined stochastic process or, when historical data are available, on kernel density estimation (KDE for short; Silverman 1986) implemented in the package.

(1986). Density estimation for statistics and data analysis. p. 3
Where the paper says it

jl, the first Julia package dedicated to scenario generation for stochastic programming. Scenario generation can be based either on a user-defined stochastic process or, when historical data are available, on kernel density estimation (KDE for short; Silverman 1986) implemented in the package.

Chapman & Hall/CRC. Sims, Christopher A. p. 5
Where the paper says it

Once the data is preprocessed, a set of predictive model families, denoted by Γ, is considered to identify the best-performing model. The families in Γ include multivariate time series models, such as vector autoregressive models (Sims 1980), and machine learning models, including support vector machines (Cortes and Vapnik 1995).

(1980). “Macroeconomics and Reality”. In: Econometrica 48.1, pp. 1–48. Sol´a Vilalta et al. p. 0
Where the paper says it

Scentree: a framework for generating scenario trees for multistage stochastic programming Cristian Pach´on-Garc´ıa, Albert Sol`a Vilalta and F-. Javier Heredia Departament d’Estad´ıstica i Investigaci´o Operativa Universitat Polit`ecnica de Catalunya September 2026 Abstract We present scentree, an open-source Python package for constructing a scenario fan and a scenario tree for multistage stochastic programming from historical data.

(2025). “Optimal Participation of Energy Communities in Electricity Markets under Uncertainty. p. 3
Where the paper says it

The authors use TSFA to (1) reduce the dimensionality of the data, (2) estimate the underlying stochastic process, and (3) predict future values, with the ultimate goal of supporting participation in the electricity market. Similarly, Sol`a Vilalta, Bosch, and Heredia (2025) apply the same methodology to construct an optimal bid curve for participation in the Spanish electricity markets.

A Multi-Stage Stochastic Programming Approach”. p. 6
Where the paper says it

This approach is also exploited by Hyndman and Shang (2009), who forecast the principal component scores of functional observations as time series. 2 Scenario tree modeling A key aspect of multistage stochastic programming is the need to consider a discrete approximation of the stochastic process.

url: https://optimization-online. p. 3
Where the paper says it

As a result, dependencies among the components of multivariate random vectors cannot be modeled, preventing the direct generation of multivariate scenario trees from data. The final package considered in this review is StochOptim, which is available at https://github.

org/?p=32105.

Green — the paper says it, and the page is printed. Red — no passage carries it, so treat that sentence as unverified. The same check runs on your own text: check a summary against its source, $5.

Improvements for AI systems

  1. Automated Scenario Generation from Historical Data: The system can construct a scenario fan by learning underlying stochastic processes using multivariate time series models and machine learning, as described in Section 3.1 of Scentree. This eliminates the need for users to specify a probability distribution, reducing the statistical expertise required to produce a scenario tree.

  2. Flexibility in Model and Tree Construction: The framework is agnostic to the specific multistage stochastic problem or predictive model used, allowing users to select any model from family Gamma. Furthermore, it allows for alternative tree construction methods because the design of scentree is agnostic to any particular algorithm, allowing new models and scenario tree construction or clustering methods to be incorporated without affecting the existing implementations.

  3. Automated Workflow Management: The system automates the complete workflow, including model selection, parameter estimation, scenario generation, and scenario tree construction, thereby reducing user expertise needed for these complex steps.

Abstract

We present scentree, an open-source Python package for constructing scenario trees for multistage stochastic programming models using either historical data or samples drawn from a probability distribution. It combines machine learning and multivariate time series models to obtain a scenario fan that captures dependencies in the stochastic processes. This scenario fan is subsequently reduced into a scenario tree that preserves representativeness of the stochastic process, providing a flexible and extensible framework for uncertainty modeling in stochastic programming problems. The framework can also be naturally applied to two-stage stochastic programming problems. Key contributions are the joint modeling of the stochastic process, preserving correlations between all random variables, and the automation of the complete workflow, including forecasting model selection, parameter estimation, scenario fan generation, and scenario tree construction. In addition, scentree does not assume any underlying data distribution, reducing the statistical expertise required to produce a scenario tree, and is modular by design, allowing external forecasts and other partial executions of the workflow.

Sources

Related papers