Multilevel network meta-regression for multistate models: Population-adjusted joint synthesis of progression and survival from individual and aggregate data
Listen
Radio episode about this paper
Transcript
Introduction to the show: ident: Statistics. The day in statistics: methods, theory and the inference under them.
Tom: I'm Tom.
Jane: And I'm Jane, here with Lu, Meng and our in-house large language model, Lalam.
Tom: We're looking at the paper: "Multilevel network meta-regression for multistate models".
Jane: Here's the gist of the paper. Detailed Research Summary: Multilevel Network Meta-Regression for Multistate Models (ML-NMR-MS) This research introduces Multilevel Network Meta-Regression for Multistate Models (ML-NMR-MS), a sophisticated statistical framework designed to overcome the limitations of existing network meta-analysis (NMA) methods when synthesizing progression-free survival (PFS) and overall survival (OS) data in oncology.
Tom: The core innovation lies in its ability to coherently integrate both individual participant data (IPD) and aggregate data (AgD), which is crucial for adjusting treatment effects for imbalances in effect-modifying covariates across trials—a known weakness of simpler multistate NMA approaches like Jansen et al.'s Markov model.
Jane: Model Structure and Integration: ML-NMR-MS embeds the integrated likelihood from Multilevel Network Meta-Regression (ML-NMR)—which combines IPD and AgD—directly within an illness–death multistate Markov model.
Tom: This allows the framework to simultaneously model the joint progression–death process rather than treating PFS and OS as entirely separate endpoints, recognizing that PFS can serve as a natural surrogate for OS.
Title and authors: Tom: Let's talk about the authors and the title again, because it sets up the whole argument. The paper is titled "Multilevel network meta-regression for multistate models: Population-adjusted joint synthesis of progression and survival from individual and aggregate data," and the authors are Jeroen Jansen, along with others from UCSF >
Jane: I'm curious about the structure of that title. It’s quite long, so can you break down what "multilevel network meta-regression" means in plain English for someone who isn't deep into biostatistics?
Lu: Multilevel network meta-regression suggests they are using a hierarchical modeling approach on top of a network meta-analysis, which lets them handle the structure of the data across different trials and individual patients simultaneously >
Meng: And what about that "multistate models" part? It means they aren't just looking at one outcome; they are tracking patients through several possible health states, like stable, progressed, or dead >
Tom: Right. So when you put those together—MLNMR and multistate models—it means they can synthesize progression and survival data jointly while adjusting for those imbalances in study characteristics that mess up simpler methods >
Jane: That sounds complex. When the paper talks about synthesizing progression and survival from individual and aggregate data, what's the practical difference between just using one or the other?
Lalam: The key difference is that by integrating both, they get a more complete picture of the underlying disease process because they are using both patient-level data and summary statistics from the studies >
The paper's summary: Tom: Okay, so summarizing what they actually did in this paper. They introduced an integrated likelihood that combines individual participant data and aggregate data into a multistate Markov model >
Jane: So, instead of just looking at the average survival curves from the studies, they are building a model that describes how patients move between states—stable to progressed to dead—using the information from every single patient record and all the summarized trial counts >
Lu: The paper points out that their original MLNMR integrates this individual-level model and its general likelihood extension, which is different from simpler approaches because it uses grouped counts within a multistate model >
Meng: What they're doing is calculating state occupancy probabilities using quasi-Monte Carlo integration of those transition intensities over a reconstructed covariate distribution, which gives them the likelihood contribution for the aggregate data >
Tom: And then they plug these marginalized probabilities into a conditional-survival binomial likelihood, which is how they combine everything into one big model >
Jane: So what’s the actual result of this integration? They claim that because their treatment and effect-modifier coefficients carry no study index, they get population-adjusted joint PFS and OS relative treatment effects >
Lalam: That means the estimate for a treatment effect is adjusted for where you are in the target population defined by a specific covariate distribution, and they also provide absolute state-occupancy quantities >
The paper's improvements: Tom: The authors highlight three main improvements. First, they introduce this novel embedding of the MLNMR integrated IPD plus AgD likelihood inside a multistate model >
Jane: That’s the mechanism. But what’s the real benefit? Why is that embedding better than just running separate analyses for PFS and OS and then trying to combine them later >
Lu: The second major improvement is achieving population-adjusted joint PFS/OS relative treatment effects under the assumption of conditional constancy of relative effects >
Meng: That means if you are looking at a specific group, say patients with a certain comorbidity profile, the estimate is tailored for that group, not just some average across everyone >
Tom: And the third point is that they illustrate this method on a network of multiple myeloma trials and show its bias and coverage when compared against a full-IPD gold standard in a simulation study where the truth is already known >
Jane: So, the authors are showing that their approach isn't just theoretically sound but also performs reasonably well when tested against the most detailed data possible >
Conclusion: Tom: To wrap up, this paper, "Multilevel network meta-regression for multistate models: Population-adjusted joint synthesis of progression and survival from individual and aggregate data," provides a single framework that handles both individual patient details and summary trial data in a way that yields population-adjusted estimates >
Jane: Essentially, it moves us away from treating PFS and OS as totally separate outcomes, showing how they are actually connected through the same underlying disease process >
Lu: The main implication for modeling is that you can parameterize state transition economic models directly using the absolute state-occupancy quantities they derive, which lets you build very specific models for health economics >
Meng: From a production standpoint, we have to consider how much precision we lose by replacing individual data with aggregate curves, and this paper shows us how to quantify that precision penalty against the full IPD gold standard >
Lalam: And they showed that their two-binomial composite likelihood approach is well calibrated, meaning the results are trustworthy and have good coverage, matching empirical standard error in calibration studies >
Tom: So we’re looking at a method that offers joint PFS and OS relative treatment effects adjusted for population characteristics using both individual and aggregate evidence. It’s a big step forward in synthesizing complex survival data >
Jane: And it gives us a robust tool to move toward making decision-relevant estimates for specific patient populations, which is exactly what we need in this field >
University of California, San Francisco · Philip R. Lee Institute for Health Policy Studies
stat.ME
Submitted: 2026-07-27
Updated: 2026-11-12
License: http://creativecommons.org/licenses/by/4.0/
Importance score: 90/100
The gist: Multilevel Network Meta-Regression for Multistate Models (ML-NMR-MS) This research introduces Multilevel Network Meta-Regression for Multistate Models (ML-NMR-MS)…
Key concepts
- Multilevel Network Meta-Regression (ML-NMR)
- This technique integrates data from individual patients with aggregate study data. It helps adjust treatment effect estimates for imbalances in other patient characteristics across different clinical trials, making the synthesis more accurate when studies are not perfectly balanced.
- Multistate Markov Model
- This model tracks a patient's progression through different health states over time, such as stable, progressed, or dead. It treats progression and death as linked events rather than separate endpoints to capture the full survival trajectory.
- Population-Adjusted Effects
- The framework calculates treatment effects tailored to a specific target population defined by its characteristics. This means the results are adjusted for the distribution of patient traits, providing estimates that are relevant for a particular group of patients rather than just an average across all participants.
Terminology
Summary
Multilevel Network Meta-Regression for Multistate Models (ML-NMR-MS)
This research introduces Multilevel Network Meta-Regression for Multistate Models (ML-NMR-MS), a sophisticated statistical framework designed to overcome the limitations of existing network meta-analysis (NMA) methods when synthesizing progression-free survival (PFS) and overall survival (OS) data in oncology. The core innovation lies in its ability to coherently integrate both individual participant data (IPD) and aggregate data (AgD), which is crucial for adjusting treatment effects for imbalances in effect-modifying covariates across trials—a known weakness of simpler multistate NMA approaches like Jansen et al. p. 0 addresses this with a tri-state
(stable, progressed, dead) Markov model fitted to aggregate survival curves, but it cannot adjust
for imbalance in effect-modifying covariates across trials, so its relative effects may be biased
or not relevant for the target population of interest. Multilevel network meta-regression (MLNMR) resolves covariate imbalance by integrating an individual-level model over the aggregate
covariate distribution, coherently combining individual participant data (IPD) and aggregate
data (AgD); however, it has been developed only for single-endpoint outcomes.Where the paper says it
Model Structure and Integration:
ML-NMR-MS embeds the integrated likelihood from Multilevel Network Meta-Regression (ML-NMR)—which combines IPD and AgD—directly within an illness–death multistate Markov model. This allows the framework to simultaneously model the joint progression–death process rather than treating PFS and OS as entirely separate endpoints, recognizing that PFS can serve as a natural surrogate for OS. p. 2 2 and then developed in full for the tri-state illness–death
model that recurs in oncology: at time u (from randomization) a patient is stable (S), progressed
(P), or dead (D), with transitions R = {SP, SD, P D}. PFS is then the probability of remaining
stable and OS the probability of being alive (stable or progressed), so both endpoints are functions
of the same underlying process.Where the paper says it
The methodology employs a clock-forward
approach, modeling every transition intensity (including progression to death) as a function of time since randomization, thus defining the process as a time-inhomogeneous Markov process.
Handling Data Sources:
-
Individual Participant Data (IPD): For studies with IPD, the full multistate likelihood over linked transitions is utilized, built upon the same underlying model structure defined in Section 2.2 of the paper, which specifies survival probabilities based on Weibull distributions for transitions between states (Stable, Progressed, Dead). p. 1
Where the paper says it
Patients occupy one of three states, namely stable (pre-progression), progressed, or dead, and the model synthesizes the three transition intensities (stable→progression, stable→death, progression→death) with time-varying (fractional-polynomial) baseline hazards and treatment effects. Because published Kaplan–Meier curves for PFS and OS do not reveal which patient’s progression time corresponds to which death time, the method works with the state-occupancy probabilities implied by the transition intensities, fitted through a conditional-survival binomial likelihood.
-
Aggregate Data (AgD): The integration of aggregate data is achieved through a sophisticated ML-NMR step. This involves computing covariate-marginal state-occupancy probabilities by quasi-Monte Carlo integration of the occupancies implied by the transition intensities over a reconstructed covariate distribution. p. 0
These marginalized probabilities are then entered into a conditional-survival binomial likelihood derived from reconstructed life-table counts, rather than treating pseudo-individual records as direct IPD. p. 6Where the paper says it
This paper introduces multilevel network meta-regression for multistate models (ML-NMR-MS), which embeds the ML-NMR integrated IPD-plus-AgD likelihood inside an illness–death multistate model. For IPD studies the full multistate likelihood over linked transitions is used; for AgD studies covariate-marginal state-occupancy probabilities are computed by quasi-Monte-Carlo integration of the occupancies implied by the transition intensities over the reconstructed covariate distribution, and entered through a conditional-survival likelihood.
Where the paper says it
But PFS and OS are dependent functionals of the same trajectory (being stable contributes to both), so treating them as two independent binomials forms a composite (pseudo-)likelihood [11]: point estimates remain consistent, but the resulting pseudo-posterior is miscalibrated (its credible intervals (CrIs) lack an exact coverage interpretation) and ordinary information criteria are not valid on the aggregate contribution. The properly-calibrated alternative treats the interval jointly: those alive at um are partitioned at um′ into the three occupancy states (nS, nP , nD)jk,m, whose covariate-marginal probabilities follow from the marginal occupancies (7) as ¯qS,jk,m = S¯ jk(um′)/Ajk,m, ¯qP,jk,m = P¯ jk(um′)/Ajk,m and q¯D,jk,m = 1 − q¯S,jk,m − q¯P,jk,m, with Ajk,m = S¯ jk(um) + P¯ jk(um) the marginal probability of being alive at um, giving a single multinomial (nS, nP , nD)jk,m ∼ Multinomialn cOS jk,m, (¯qS,jk,m, q¯P,jk,m, q¯D,jk,m) , (11) a marginalized Welton–Ades aggregate-Markov likelihood [12] that respects the PFS/OS dependence and yields a genuine posterior.
Output and Key Contributions:
The primary strength of ML-NMR-MS is its output: it yields conditional and marginal relative treatment effects, alongside absolute quantities, for a specified target population P characterized by covariate distribution f(P). Crucially, because the treatment and effect-modifier coefficients are study-index agnostic, the method provides population-adjusted joint PFS/OS relative treatment effects under the assumption of conditional constancy of relative effects.
The paper's main contributions are threefold:
-
Novel Embedding: Embedding the ML-NMR integrated IPD-plus-AgD likelihood inside a multistate model.
-
Population Adjustment: Achieving population-adjusted joint PFS/OS relative treatment effects due to the structure of the coefficients.
-
Validation: Illustrating the method's performance on a network of multiple myeloma trials by examining its bias and coverage against a full-IPD gold standard in a simulation study with fully known truth, confirming unbiased recovery and near-nominal coverage under correct specification.
Calibration Findings:
Calibration studies comparing different likelihood approaches confirmed the robustness of ML-NMR-MS. Specifically, while the multinomial state-occupancy likelihood was found to be overconfident due to information injection from reconstructing joint counts from marginal curves, the two-binomial composite likelihood approach was well calibrated, with its average posterior standard deviation matching empirical standard error and achieving coverage close to nominal (0.96).
**In essence, ML-NMR-MS provides a single, coherent framework for synthesizing individual and aggregate progression and survival data into population-adjusted estimates of treatment effects, making it exceptionally well-suited for parameterizing complex health-economic state-transition models. p. 0 This yields population-adjusted
joint PFS/OS treatment effects and can directly parameterize a state-transition economic model. On an illustrative oncology network, ML-NMR-MS resolves a treatment’s joint effect into its
component transitions, separating an effect on progression from an effect on post-progression
survival, and produces conditional and marginal effects.Where the paper says it
Green — the paper says it, and the page is printed. Red — no passage carries it, so treat that sentence as unverified. The same check runs on your own text: check a summary against its source, $5.
Improvements for AI systems
-
Ability to estimate population-adjusted conditional treatment effects using both conditional and marginal approaches, which are described as
conditional and marginal relative treatment effects.
This allows for decision-relevant estimates that arepopulation-adjusted
even when studies have imbalanced covariates. -
Capability to parameterize state transition economic models directly by using the derived absolute quantities, such as
absolute state-occupancy quantities,
which can be used to do so. -
Capacity to decompose an overall survival effect into its components on progression versus post-progression mortality, allowing the system to determine
how much of an OS effect is routed through progression.
-
Functionality to produce time-varying hazard ratios for stable-to-progression transitions, capturing
the positive gamma SP t driving the attenuation
and showing how these effects shift across different target populations. -
Skill in assessing the precision and information cost of using aggregate data by comparing ML-NMR-MS against a full IPD comparator, quantifying the
precision penalty for replacing individual data by aggregate curves.
Abstract
In network meta-analysis (NMA) of oncology time-to-event outcomes, there is growing recognition that progression-free survival (PFS) and overall survival (OS) are better synthesized jointly than in separate analyses. The multistate NMA of Jansen et al. addresses this with a tri-state (stable, progressed, dead) Markov model fitted to aggregate survival curves. It cannot, however, adjust for imbalance in effect modifiers across trials, so its relative effects may be biased or not apply to the target population. Multilevel network meta-regression (ML-NMR) resolves covariate imbalance by integrating an individual-level model over each aggregate study's covariate distribution, coherently combining individual participant data (IPD) and aggregate data (AgD); however, for time-to-event outcomes it has been developed only for a single endpoint. This paper introduces multilevel network meta-regression for multistate models (ML-NMR-MS), which embeds the ML-NMR integrated IPD-plus-AgD likelihood inside an illness-death multistate model. For IPD studies the full multistate likelihood over linked transitions is used; for AgD studies covariate-marginal state-occupancy probabilities are computed by quasi-Monte Carlo integration of the occupancies implied by the transition intensities over the reconstructed covariate distribution, and entered through a conditional-survival likelihood. The resulting population-adjusted joint PFS/OS treatment effects can directly parameterize a state-transition economic model. On an illustrative network, ML-NMR-MS resolves a treatment's joint effect into its component transitions, separating an effect on progression from an effect on post-progression survival, and produces conditional and marginal effects. Under correct specification, a simulation study with known truth shows negligible bias and near-nominal coverage for the population-adjusted treatment effects.
Sources
Related papers
- Learning Robust Treatment Rules for Censored Data
- Neural Estimation of Summary Statistics for Simulation-Based Inference with Non-Asymptotic Guarantees
- Spectral divide-and-conquer MCMC for long stationary time series
- Improving the Efficiency of Subgroup Analysis in Randomized Controlled Trials with TMLE
- Personalized Federated Vector Autoregression with Personalization Diversity
- Doubly Robust and Efficient Calibration of Prediction Sets for Right-Censored Time-to-Event Outcomes