Scalable Bayesian inference for time-discretised Markov jump processes via exchangeable particle Gibbs
summary
The gist
Inference in stochastic reaction-network models, such as the susceptible-exposed-infectious-recovered (SEIR) epidemic model…
In short
The paper introduces exchangeable particle Gibbs (xPG) to improve inference in reaction networks modeled by Markov jump processes, specifically addressing particle degeneracy. By correlating proposed paths with a reference path, xPG handles discrete-state spaces driven by Poisson processes. Tuning strategies for parameters like delta and M maximize sample efficiency across various epidemic models.
Key concepts
- Particle Gibbs (PG)
- A Monte Carlo method used to estimate the posterior distribution of model parameters by simulating a sequence of paths through the state space. It involves generating new paths based on current ones and updating parameters using these samples.
- Exchangeable Particle Gibbs (xPG)
- An adaptation of PG that improves efficiency by correlating proposed paths with a reference path. This method is tailored for discrete-state reaction networks where randomness is driven by Poisson processes, overcoming the degeneracy problem common in standard PG methods.
- Particle Degeneracy
- A problem in particle filtering where successive resampling steps discard most ancestor trajectories, leaving very few unique particles to represent the system's historical path. This severely limits the ability of standard MCMC methods to explore the full parameter space effectively.
- Backward Sampling Extension (PGBS)
- An extension that helps counter degeneracy by allowing a point at time t to choose a different ancestor from time t-1 instead of just using the immediate predecessor. This technique is effective for reaction networks where reaction counts are uniquely determined by state pairs.
Terminology used across episodes
This episode discusses
- Scalable Bayesian inference for time-discretised Markov jump processes via exchangeable particle Gibbs · Paper Radio
- Particle-MALA and Particle-mGRAD: Gradient-based MCMC methods for high-dimensional state-space models
The paper
Scalable Bayesian inference for time-discretised Markov jump processes via exchangeable particle Gibbs · Read on arXiv
Lanya Yang, Lloyd A. C. Chapman, Chris Sherlock
Lancaster University
Inference in stochastic reaction-network models, such as the susceptible-exposed-infectious-recovered (SEIR) epidemic model, is crucial for understanding the dynamics of interacting systems in epidemiology, ecology, and systems biology. These models are typically represented as Markov jump processes (MJPs), with discrete, noisy observations and intractable likelihoods. Particle Markov chain Monte Carlo (PMCMC) offers a natural mechanism for inference on these hidden Markov models, but, even in moderate dimensional state spaces, particle degeneracy typically leads to poor mixing of the PMCMC algorithm. This paper focuses on improving the efficiency of particle Gibbs for inference on reaction networks by addressing the degeneracy problem. Building on recent work on the exchangeable particle Gibbs (xPG) sampler for diffusions, this paper develops a novel version of xPG tailored to discrete-state-space reaction networks, where randomness is driven by Poisson processes rather than Brownian motion. We focus on the τ-leap discretisation of the MJPs. The proposed method retains the exchangeability framework of xPG while adapting it to the structural and computational challenges specific to reaction networks. The new method is applied to several examples, including four coupled SEIR models, where it substantially improves mixing efficiency compared with standard particle Gibbs. In this example, xPG improves sample efficiency by more than an order of magnitude relative to standard particle Gibbs, making inference feasible in hours rather than weeks. As part of our tuning strategy, we provide a mechanism for tuning the number of particles that is applicable more generally, to any particle Gibbs algorithm.
Transcript
Introduction to the show: ident: Statistics. The day in statistics: methods, theory and the inference under them.
Tom: We're looking at the paper: "Scalable Bayesian inference for time-discretised Markov jump processes via exchangeable particle Gibbs".
Jane: Here's the gist of the paper. Inference in stochastic reaction-network models, such as the susceptible-exposed-infectious-recovered (SEIR) epidemic model, is crucial for understanding the dynamics of interacting systems in epidemiology, ecology, and systems biology This paper focuses on improving the efficiency of particle Gibbs for inference on reaction networks by addressing the degeneracy problem The proposed method retains the exchangeability framework of xPG while adapting it to the structural and computational challenges specific to reaction networks The Core Methodology The paper develops a novel version of exchangeable particle Gibbs (xPG) tailored to discrete-state-space reaction networks, where randomness is driven by Poisson processes rather than Brownian motion This method is applied to the tau-leap discretisation of the MJPs The proposed method retains the exchangeability framework of xPG while adapting it to the structural and computational challenges specific to reaction networks Addressing Particle Degeneracy Particle degeneracy occurs when over successive resampling steps in the internal particle filter most of the ancestor trajectories get discarded leaving very few unique particles to represent the historical path of the system The paper introduces xPG, which is intended for discrete-time models with continuous state spaces The key idea of xPG applied to SDEs is to correlate both the initial state X0 and the Brownian motions of the proposed paths with the equivalent quantities in the reference path rather than simulating them independently Tuning and Efficiency Metrics The paper proposes a strategy for tuning two parameters: δ, which controls the correlation between the proposed paths and the reference path in the conditional particle filter (smaller δ =⇒ more correlated), and M, the number of alternative proposed paths The strategy targets an optimal acceptance rate for the worst mixing state, which is not only valid for xPG, but can also be used to find the optimal number of particles M for any particle Gibbs algorithm The sample efficiency is assessed using a metric defined as Eff = minl,d ESS(Xd tl) / M Comparative Performance The paper compares xPG and particle Gibbs (PG) on data simulated from SIS, SIR, and SEIR models with univariate and multivariate state spaces In the four coupled SIR models, xPGBS achieves the highest sample efficiency for the worst mixing component of the state for PGBS being approximately seven times higher than for PGBS For SEIR models, xPGBS is only slightly better for the lowest sample efficiency of the model parameters for PG (η), xPG is 21 times better, and xPGBS is 76 times better Backward Sampling Extension The paper describes a method for incorporating backward sampling into both particle Gibbs and exchangeable particle Gibbs yielding particle Gibbs with backward sampling (PGBS) and exchangeable particle Gibbs with backward sampling (xPGBS) This method is only practicable for reaction networks in which the reaction counts are uniquely determined by a given pair of states, such as the SIR and SEIR models The tuning heuristics suggest that the optimal value of M, which maximizes sample efficiency is Mˆ = E The corresponding optimal acceptance rate is αˆ:= exp(−1) ≈ 0.368 In practice, to maximise efficiency over (δ, M) we restrict attention to the curve αMδ ≈ αˆ using the following procedure The optimal value of M for xPGBS are substantially smaller than those for xPG However, both xPG and xPGBS attain their optima at relatively small values of δ For the SIR and SEIR models, the minimum ESS over all latent states and observation time points does not necessarily occur at the first observation time The tuning strategy may overestimate the number of particles required Further Research Directions An xPG method based on exact simulation of MJPs would remove the bias caused by discretisation and forced boundaries and is a promising direction for future research The paper concludes that xPG is also the first algorithm to make exact joint inference of the latent states and rate parameters of the five-dimensional autoregulatory model of Golightly and Wilkinson (2005) from a sequence of exact state observations feasible The paper is based on the tau-leap approximation of MJPs Smaller τ gives a more accurate approximation but increases computational cost Moreover, boundary conditions, such as all the states being non-negative must be enforced when applying xPG and xPGBS The paper is 2611.05232.
Tom: <ref:2611.05232#pg5> Inference in stochastic reaction-network models, such as the susceptible-exposed-infectious-recovered (SEIR) epidemic model, is crucial for understanding the dynamics of interacting systems in epidemiology, ecology, and systems biology <ref:2611.05232#pg2> This paper focuses on improving the efficiency of particle Gibbs for inference on reaction networks by addressing the degeneracy problem <ref:2611.05232#pg3> The proposed method retains the exchangeability framework of xPG while adapting it to the structural and computational challenges specific to reaction networks <ref:2611.05232#pg3> Reaction networks are commonly used to describe dynamic processes in chemistry, epidemiology, ecology and biology <ref:2611.05232#pg3> They can be represented by Markov jump processes (MJPs), which are continuous-time discrete-state-space stochastic processes <ref:2611.05232#pg3> The tau-leap discretisation of the MJPs is a popular approximation of the evolution of an MJP <ref:2611.05232#pg3> Mathematical Formulation The mathematical form of a time-homogeneous HMM in continuous time is given by X0 ∼ p0(· θ), X(tl−1,tl] (x
0,tl−1: , y1:l−1, θ) ∼ p(· xtl−1, θ), Yl (x
0,t: , y1:l-1, θ) ∼ g(· xtl, θ) <ref:2611.05232#pg3> The state updates according to Xt = Xt− + Γi where Γi = (bi1 − ai1,..., biu − aiu) T <ref:2611.05232#pg3> Particle Gibbs Mechanism In each iteration, it first generates M new paths based on the current reference path using the conditional particle filter <ref:2611.05232#pg3> Next, it updates the reference path by sampling a new path from these M + 1 paths including the current reference path <ref:2611.05232#pg3> Finally, it updates the model parameters according to their conditional distribution given the selected reference path <ref:2611.05232#pg3> Exchangeable Particle Gibbs Details The exchangeable particle Gibbs algorithm replaces the standard conditional particle filter with the exchangeable conditional particle filter <ref:2611.05232#pg4> The joint proposal density is defined as q˜(x(1:M)tx(0)t, x(0:M)t−τ) = q((M)(x(0:M)tx(0:M)t−τ))q(xtxt−τ) <ref:2611.05232#pg4> Backward Sampling Extension Backward sampling is an extension to particle Gibbs which seeks to counter particle degeneracy by allowing a point at time t to choose a different time t−1 ancestor <ref:2611.05232#pg3> The backward sampling step is performed immediately after step 6 in the particle Gibbs algorithm <ref:2611.05232#pg3> Tuning Strategy Summary The tuning strategy targets an optimal acceptance rate for the worst mixing state, which is not only valid for xPG, but can also be used to find the optimal number of particles M for any particle Gibbs algorithm <ref:2611.05232#pg4> The sample efficiency plots for the SIS models (Figure 1) show that picking δ and M following the tuning rule gives close to optimal sample efficiency <ref:2611.05232#pg4> Numerical Results Summary The numerical experiments show that xPG attains the maximum ESS for X4 at time zero when δ = 0.05, whereas xPG with δ = 0.5 fails to move X4 from its initial value <ref:2611.05232#pg4> The results suggest that for the autoregulatory model, xPG achieves higher sample efficiency than nMESA <ref:2611.05232#pg4> For the SIR and SEIR models, adding backward sampling to particle Gibbs improves sample efficiency, but much less than using xPGBS <ref:2611.05232#pg4> Discussion Summary The benefit of xPG over PG is most pronounced when the observations are highly informative <ref:2611.05232#pg3> In contrast, when the observations are less informative, standard particle Gibbs may already produce a reasonably large proportion of particles with high weights <ref:2611.05232#pg3> The paper is 2611.05232.
Jane: References Andrieu, C., A.
Tom: Doucet, and R.
Title and authors: Tom: So we're looking at this paper, "Scalable Bayesian inference for time-discretised Markov jump processes via exchangeable particle Gibbs." The authors are Yang, Chapman, and Sherlock. It's essentially about making particle Gibbs more efficient when dealing with these reaction networks.
Jane: That sounds like it deals with those complex systems in epidemiology or chemistry where you have discrete steps over time, right? What’s the big picture here for someone listening who isn't deep in stochastic processes?
Lu: It tackles the problem of particle degeneracy which is a major hurdle when using these methods on reaction networks because most of your generated paths just get thrown away after a few resampling steps.
Meng: Particle degeneracy sounds like when you try to track millions of possible paths, but only a few actually survive the filtering process. That's bad for running models at scale, right?
Lalam: Exactly. The paper introduces something called exchangeable particle Gibbs which tries to fix that by changing how it generates new paths relative to the historical path instead of treating them as completely independent random walks.
The paper's summary: Tom: So, what the authors are doing is developing this xPG method, which keeps the exchangeability structure but adapts it specifically for reaction networks where randomness comes from Poisson processes rather than those standard Brownian motions we usually see in other models.
Jane: That makes sense because reaction networks often deal with counts of individuals or molecules, which naturally lead to those Poisson distributions they mention. So, instead of assuming continuous movement like in some SDEs, they are working with discrete state spaces driven by jumps.
Lu: The core idea is to correlate the initial state and the Brownian motions of the proposed paths with equivalent quantities in a reference path, rather than simulating them completely independently. That correlation helps keep those important historical trajectories alive during resampling.
Meng: If you're running a production model, that sounds like an improvement because it means less wasted computation when you're trying to infer parameters for something like an SEIR model. It’s about improving the mixing of the algorithm itself.
Lalam: They also looked at backward sampling and showed that the exchangeable version with backward sampling, called xPGBS, is actually the most efficient of four algorithms they tested on those reaction networks.
The paper's improvements: Tom: The paper proposes a tuning strategy for two parameters, delta and M. Delta controls how correlated the proposed paths are with the reference path—smaller delta means more correlated paths—and M is the number of alternative proposed paths you generate in each run.
Jane: So they aren't just throwing a black box method at us; they’re giving us concrete ways to tune these settings to get better results, specifically targeting an optimal acceptance rate for the worst mixing state.
Lu: They found that this tuning strategy actually helps find the optimal number of particles M for any particle Gibbs algorithm, which is pretty powerful because it gives you a rule instead of just guessing.
Meng: From an engineering standpoint, if we can use this to find the right M without running through massive sweeps over all settings, that's a win for deployment. It means we can control the computational cost more predictably.
Lalam: They showed that when you follow this tuning rule, like picking delta and M based on those acceptance rates, you get close to optimal sample efficiency on data simulated from SIS, SIR, and SEIR models with both univariate and multivariate state spaces.
Conclusion: Tom: So to wrap up, the main thing is that xPGBS is the most efficient algorithm they tested for those reaction networks, achieving sample efficiency gains over standard particle Gibbs. They also found that for some models like SEIR, adding backward sampling to just particle Gibbs isn't as helpful as using the full xPGBS method.
Jane: What this means for us is that when you’re working with these types of discrete state-space models, especially those with reaction counts, you should look at xPGBS first if your goal is maximum efficiency.
Lu: They also pointed out some practical limitations. For instance, the optimal number of particles M they found for xPGBS are substantially smaller than what they found for standard particle Gibbs, and the best performance sometimes happens when delta is quite small.
Meng: And one thing they mentioned is that for SIR and SEIR models, the minimum efficiency doesn't always happen at time zero; it can occur at a later observation time point. So you can't just assume the first step is always the best spot to look for maximum efficiency.
Lalam: And finally, they conclude that this method is also the first one to allow exact joint inference of the latent states and rate parameters for a five-dimensional autoregulatory model using only exact state observations, which is a big deal for those complex kinetic models.
More episodes
- Daily Summary for 2026-11-19
- 2310.07973-Statistical Performance Guarantee for Subgroup Identification with Generic Machine Learning
- 2408.09155-Learning Robust Treatment Rules for Censored Data
- Daily Summary for 2026-11-19
- 2603.23397-Kinetic Langevin Splitting Schemes for Constrained Sampling
- 2606.09906-An information-geometric framework for mapping maximum potential biodiversity
- 2603.27718-Induced replication and the assessment of models
- 1307.0898-Entropy of a Zipfian Distributed Lexicon
- 2406.19974-Generalizing self-normalized importance sampling with couplings
- 2412.10213-Collaborative Optimal Design of Controlled Experiments with Subject Covariates