Anchors Away: Navigating Single-Arm Indirect Comparisons with Multilevel Unanchored Meta-Regression (ML-UMR-SA)
Listen
Radio episode about this paper
Transcript
Introduction to the show: ident: Statistics. The day in statistics: methods, theory and the inference under them.
Tom: We're looking at the paper: "Anchors Away: Navigating Single-Arm Indirect Comparisons with Multilevel Unanchored Meta-Regression (ML-UMR-SA)".
Jane: Here's the gist of the paper. Unanchored indirect treatment comparisons using multilevel unanchored meta-regression (ML-UMR) are proposed as a Bayesian outcome-regression framework to synthesize individual patient data and aggregate data from fully disconnected evidence.
Tom: This method is significant because it extends multilevel network meta-regression to unanchored settings by jointly modeling individual- and aggregate-level data within a unified likelihood, enabling the estimation of treatment-specific outcomes and both marginal and conditional effects across multiple treatments, studies, and target populations.
Jane: The core methodology of MLUMR MLUMR is a Bayesian modeling approach for population-adjusted indirect comparisons (PAICs) of disconnected evidence.
Tom: It uses the multilevel outcome-regression and marginalization framework of ML-NMR but applies this framework to unanchored comparisons, where the network anchoring structure is absent.
Title and authors: Tom: So we're looking at this paper now called Anchors Away: Navigating Single-Arm Indirect Comparisons with Multilevel Unanchored Meta-Regression, and it’s tackling those tough situations where you don't have a clear comparator study.
Jane: That’s right. It addresses the problem that when evidence is disconnected, like using single-arm studies, standard methods like matching adjusted indirect comparison or simulated treatment comparison often only estimate effects in the study where you got your data.
Lu: Exactly. This paper proposes something called Multilevel Unanchored Meta-Regression or MLUMR, which uses a Bayesian outcome regression framework to combine individual patient data with aggregate data from all those disconnected studies into one unified likelihood model.
Meng: It sounds like they’re trying to bridge the gap between looking at what happened in the study and what we actually care about for a specific patient population. What does that mean for someone running this on a real server?
Tom: Well, it means they’re modeling both individual patient data and aggregate data together within that single likelihood structure, which lets them estimate treatment specific outcomes and both marginal and conditional effects across multiple treatments, studies, and target populations at once.
Jane: But the core challenge they’re tackling is that you can't just assume that observed differences between groups are due to the treatment because you have these hidden population or study design differences lurking around.
Lu: That’s where they get into the identification assumptions, which are strong requirements for making valid inferences in unanchored comparisons. They list things like conditional exchangeability of potential outcomes across studies, meaning study membership must be independent of potential outcomes conditional on baseline covariates.
Meng: So it’s not just throwing data together; they have to explicitly state what assumptions they're making about the underlying structure of the evidence before you can trust the result.
Tom: Right, and one big assumption they have is positivity or overlap and extrapolation, which basically means there needs to be enough overlap between your target population and the populations in those studies for them to draw any meaningful conclusions.
Jane: And they also mention stable unit treatment value assumption or SUTVA, which is a standard requirement where the observed outcome must equal the potential outcome under the treatment actually received, which is pretty basic but important to be explicit about.
Lu: Beyond those, they require correct specification of the outcome regression model itself, including appropriate functional forms and treatment covariate interactions that account for effect modification. And then there’s this extra requirement for MLUMR: SPFA or Subgroup Identifying Information, where a shared prognostic factor assumption is a common identifying assumption they need to make explicit.
Meng: That shared prognostic factor thing sounds like another way to try and control for those unmeasured confounders that could be messing up the comparison between studies.
Tom: They’re trying to move beyond just pairwise comparisons, which is what things like matching adjusted indirect comparison or simulated treatment comparison usually do, because they are restricted to pairwise settings and often estimate effects in the comparator study population.
Title and authors: Jane: And they explicitly state that this limitation means the effect they find might not align with your actual decision-relevant population, like a specific jurisdiction or an index trial group.
Lu: The MLUMR framework differs from existing methods by adapting the multilevel network meta-regression framework to unanchored settings by jointly modeling individual patient data and aggregate data within that unified outcome regression framework.
Tom: So it’s not just applying a known technique; they are rebuilding the structure to handle those fully disjointed evidence sets where there’s no common comparator study linking them together.
Jane: And they show how this new structure allows them to position MLUMR relative to things like STC, MAIC, and even multilevel network meta-regression by showing differences in their modeling approach and the estimand they are targeting.
Meng: They table out that MLUMR supports marginal or conditional effects, which is a big thing because it means you can get different types of information depending on what decision you need to make at that moment.
Tom: And the source population for the outcome regression or weighting can be either your index trial, which is individual patient data, or all IPD and aggregate data from all studies, which is a much richer set of inputs.
Jane: This brings us to transportability, which is where they show how you actually get these results into the populations that matter for real-world decisions.
Lu: Transportability is achieved by integrating the estimated outcome model over the covariate distribution of your target population using Bayesian g-computation to get population average conditional effects, and marginal effects require explicit standardization over that same target population covariate distribution.
Meng: That sounds like a way to take an estimate from one group and adjust it mathematically so it applies correctly to another group you haven’t directly studied.
Tom: And they state the simulation study results showed that MLUMR consistently recovered effects in the comparator’s population with minimal bias and near nominal coverage, even when the shared prognostic factor assumption was violated and effect modification was strong.
Jane: But they also give a crucial caveat about transportability, saying that it depends critically on structural assumptions regarding effect modification and collapsibility.
Lu: And for future work, they suggest focusing on methods to assess and quantify violations of those strong assumptions, and quantitative bias analysis or QBA is a promising direction because it lets analysts quantify how unmeasured prognostic factors would need to behave to change conclusions.
Meng: If you can use QBA, that’s useful for checking if your model is brittle when you introduce new unmeasured variables that might be lurking in real-world data.
Tom: Another important area they point to is developing PAIC methods for partially connected evidence networks, which means dealing with situations where some studies are connected by randomized trials and others are fully disconnected sources all at the same time.
Title and authors: Jane: And they also recommend hierarchical pooling as a sensitivity analysis when you have sufficient replication across studies, which is just another way to check if your main findings hold up under different assumptions about study structure.
Lu: So, to wrap up this paper called Anchors Away: Navigating Single-Arm Indirect Comparisons with Multilevel Unanchored Meta-Regression (MLUMR-SA), the main idea is providing a Bayesian outcome regression framework that synthesizes individual and aggregate data from fully disconnected evidence into a single model.
Tom: It helps you estimate marginal or conditional effects across multiple treatments, studies, and target populations without relying on the restrictive assumptions of older methods like STC or MAIC.
Jane: And it gives you tools for population-specific standardization to transport those effects directly into decision relevant groups for health economic evaluations.
Lu: The key difference is that MLUMR supports joint likelihood encompassing all treatments, studies, individual patient data and aggregate data from all studies, which is what the authors call the feature that positions it differently in Table one of their work <ref:2606.20341#pg1,individual patient data and aggregate data>.
Meng: From a deployment standpoint, they are building a framework that allows you to specify exactly how you want to adjust those effects for different populations using g-computation for transportability.
Tom: It sounds like they’re giving health technology assessment teams the actual tools to define estimands aligned with the target population rather than relying on implicit direct transport assumptions.
Jane: The work highlights that while the simulation study performance was good, valid transport to alternative populations still depends on those structural assumptions about effect modification and collapsibility holding true.
Lu: And they are clearly setting up a path for future research by suggesting QBA and exploring PAIC methods for partially connected evidence networks where different types of evidence coexist.
Meng: If you’re running a model at scale, knowing how to quantify those assumption violations through quantitative bias analysis would be really helpful for checking the robustness of your results.
Tom: So, Anchors Away: Navigating Single-Arm Indirect Comparisons with Multilevel Unanchored Meta-Regression is about building a more flexible way to synthesize evidence when you have single-arm studies and disconnected data sets.
Jane: It moves us toward estimating both conditional and marginal treatment effects directly in decision relevant populations through standardization instead of relying on implicit transport assumptions.
Lu: And they are laying out the identification requirements clearly so analysts know exactly what structural assumptions, like SPFA, they need to make explicit for their conclusions to hold water.
Meng: It’s a practical tool for HTA because it helps you align your statistical estimands with the populations that actually matter when you’re building cost-effectiveness models.
Tom: So, if you're dealing with disconnected evidence and want robust estimates for specific populations, MLUMR offers a way to model the complexity of individual patient data alongside aggregate study data within one cohesive Bayesian framework.
The paper's summary: Tom: So we’re looking at what the paper calls Multilevel Unanchored Meta-Regression or MLUMR, and essentially they’ve built this new way to take individual patient data from lots of disconnected studies and aggregate data from those studies together into one single likelihood model.
Jane: That sounds like they’re trying to move beyond just looking at what happened in one study and making broad generalizations about a whole group of people.
Lu: Exactly, they’re joint modeling individual patient data with the aggregate data across all those sources within that unified outcome regression framework, which lets them estimate treatment specific outcomes and both marginal and conditional effects.
Meng: So it means they can actually figure out what the effect is for a specific person versus what it is for an average person in a study, all at once.
Tom: Right, because the core thing they’re doing is extending multilevel network meta-regression to unanchored settings by jointly modeling individual and aggregate data within that unified likelihood structure.
Jane: The paper makes it really clear how this framework explicitly formalizes those identification assumptions—the rules you have to follow so the math actually makes sense when you don't have a single comparator study linking everything up.
Lu: They list these requirements like conditional exchangeability of potential outcomes across studies, which means the study membership has to be independent of the potential outcomes given the baseline covariates.
Meng: That sounds like they’re basically saying if you want to trust this, you need to make a very specific assumption about how those studies are related.
Tom: And another big one they highlight is positivity or overlap and extrapolation, which means there needs to be enough overlap between your target population and the study populations for them to draw any meaningful conclusions.
Jane: It’s important because it moves the discussion from just "what is the effect?" to "under what conditions are we allowed to say this effect holds?"
The paper's summary: Lu: They also have this extra identification requirement for MLUMR, which is SPFA or Subgroup Identifying Information, where a shared prognostic factor assumption is a common identifying assumption they need to make explicit.
Meng: So they’re trying to control for those unmeasured confounders that could be messing up the comparison between studies by making an explicit bet on how those factors behave.
Tom: Beyond just making assumptions about structure, they show you how to actually get these results into the populations that matter using Bayesian g-computation to transport treatment effects into decision relevant groups.
Jane: That transportability part is where it gets practical for health technology assessment because it lets you estimate population average conditional effects and marginal effects directly in those target populations.
Lu: They do this by integrating the estimated outcome model over the covariate distribution of your target population, and for marginal effects, you need explicit standardization over that same distribution.
Meng: So instead of getting an effect from a study and then trying to guess how it applies to your specific patient group, they give you a mathematical way to adjust it based on the target group’s makeup.
Tom: And the simulation study results showed that MLUMR consistently recovered effects in the comparator’s population with minimal bias even when those shared prognostic factor assumptions were violated and effect modification was strong.
Jane: That consistency is what they want to show, but they also give a crucial caveat about transportability, saying it still depends critically on structural assumptions regarding effect modification and collapsibility holding true.
Lu: And for future work, they suggest focusing on methods to assess and quantify violations of those strong assumptions using quantitative bias analysis or QBA because that lets analysts quantify how unmeasured prognostic factors would need to behave to change conclusions.
Meng: If you can use QBA, that’s useful for checking if your model is brittle when you introduce new unmeasured variables that might be lurking in real-world data.
Tom: Another important area they point to is developing PAIC methods for partially connected evidence networks, which means dealing with situations where some studies are connected by randomized trials and others are fully disconnected sources all at the same time.
The paper's summary: Jane: It’s a big step forward because it shows how this framework can handle a messy reality where you have both structured and unstructured evidence sources mixed together.
Lu: They also recommend hierarchical pooling as a sensitivity analysis when you have sufficient replication across studies, which is just another way to check if your main findings hold up under different assumptions about study structure.
Meng: So, to sum it up, this paper gives us a Bayesian outcome regression framework that synthesizes individual and aggregate data from fully disconnected evidence into one cohesive model.
Tom: It helps you estimate marginal or conditional effects across multiple treatments, studies, and target populations without relying on the restrictive assumptions of older methods like simulated treatment comparison or matching adjusted indirect comparison.
Jane: And it gives you tools for population-specific standardization to transport those effects directly into decision relevant groups for health economic evaluations instead of relying on implicit direct transport assumptions.
Lu: The key difference is that MLUMR supports a joint likelihood encompassing all treatments, studies, individual patient data and aggregate data from all studies, which is what the authors call the feature that positions it differently in Table one of their work.
Meng: From a deployment standpoint, they are building a framework that allows you to specify exactly how you want to adjust those effects for different populations using g-computation for transportability.
Tom: It sounds like they’re giving health technology assessment teams the actual tools to define estimands aligned with the target population rather than relying on implicit direct transport assumptions.
Jane: The work highlights that while the simulation study performance was good, valid transport to alternative populations still depends on those structural assumptions about effect modification and collapsibility holding true.
Lu: And they are clearly setting up a path for future research by suggesting QBA and exploring PAIC methods for partially connected evidence networks where different types of evidence coexist.
The paper's improvements: Tom: So they’re looking at how to actually improve this MLUMR framework, and what those improvements mean for making these comparisons more robust on a real deployment scale.
Jane: What are the actual suggested upgrades? They have to be practical because right now we’ve seen good simulation results but we still have big questions about real-world data.
Lu: They suggest focusing on methods for assessing and quantifying violations of those strong identification assumptions, and quantitative bias analysis or QBA is a promising direction because that lets analysts quantify how unmeasured prognostic factors would need to behave to change conclusions.
Meng: Quantifying the violation sounds like it could be useful for checking if our model is brittle when we introduce new unmeasured variables that are just lurking in production data.
Tom: Yeah, because I hate claims with no number behind them, and QBA gives us a way to put a number on how much things could change.
Jane: And they also recommend developing PAIC methods for partially connected evidence networks where some studies are connected by randomized trials and others are fully disconnected sources all at the same time.
Lu: That’s important because it addresses the situation where you have both structured and unstructured evidence sources mixed together in your research pool.
Meng: If we can handle that mix, it means we can synthesize evidence from a variety of study types for a single treatment without having to isolate the RCTs first.
Tom: That’s interesting because right now, many systems struggle when you mix different levels of evidence like that.
Jane: They also recommend hierarchical pooling as a sensitivity analysis when you have sufficient replication across studies, which is just another way to check if your main findings hold up under different assumptions about study structure.
Lu: Hierarchical pooling lets you look at how the results change if you assume different levels of nesting or structure in your network, which helps test the robustness of the final estimates.
Meng: That sounds like a good sanity check for any production system before we commit to a deployment strategy based on these estimates.
Tom: So they’re giving us tools not just to run the model, but to rigorously test its boundaries and see where it might break in the real world.
Jane: The implication for us is that we need more than just a working model; we need a way to measure exactly how much uncertainty those structural assumptions are adding versus the actual noise in the data.
Lu: Exactly, they’re moving toward building tools that can tell you precisely where your confidence in the treatment effect starts to erode when you move from simulation to real data.
Conclusion: Tom: So to wrap up, "Anchors Away: Navigating Single-Arm Indirect Comparisons with Multilevel Unanchored Meta-Regression," they’ve given us this Bayesian outcome regression framework that combines individual patient data from many disconnected studies and aggregate study data into one single model.
Jane: Basically, it’s a way to synthesize evidence when you don't have a clear comparator study linking everything up.
Lu: It helps estimate marginal or conditional effects across multiple treatments, studies, and target populations without relying on the restrictive assumptions of older methods like simulated treatment comparison or matching adjusted indirect comparison.
Meng: It gives us tools for population-specific standardization to transport those effects directly into decision relevant groups for health economic evaluations instead of relying on implicit direct transport assumptions.
Tom: The key difference is that MLUMR supports a joint likelihood encompassing all treatments, studies, individual patient data and aggregate data from all studies, which is what the authors call the feature that positions it differently in Table one of their work.
Jane: And they are laying out the identification requirements so analysts know exactly what structural assumptions like SPFA they need to make explicit for their conclusions to hold water.
Lu: They also lay out how to get these results into populations using Bayesian g-computation for transportability, which is a big deal because it lets you define estimands aligned with the target population instead of relying on implicit transport assumptions.
Meng: It sounds like they’re giving health technology assessment teams the actual tools to define exactly how they want to adjust those effects for different populations using that g-computation method.
Tom: The work highlights that while simulation study performance was good, valid transport still depends on structural assumptions about effect modification and collapsibility holding true.
Jane: And they are clearly setting up a path for future research by suggesting quantitative bias analysis or QBA to quantify violations of those strong assumptions.
Lu: They also recommend exploring PAIC methods for partially connected evidence networks where different types of evidence coexist, which is a huge area for more advanced modeling.
Meng: If you can use QBA, that’s useful for checking if our model is brittle when we introduce new unmeasured variables that are just lurking in real-world data.
Tom: So, to sum it up, "Anchors Away: Navigating Single-Arm Indirect Comparisons with Multilevel Unanchored Meta-Regression" is about building a more flexible way to synthesize evidence when you have single-arm studies and disconnected data sets.
Jane: It moves us toward estimating both conditional and marginal treatment effects directly in decision relevant populations through standardization instead of relying on implicit transport assumptions.
Lu: They are laying out the identification requirements so analysts know exactly what structural assumptions, like SPFA, they need to make explicit for their conclusions to hold water.
Tom: I think this means that for anyone doing health tech assessment, they have a new way to define estimands aligned with the population actually used in cost-effectiveness models.
Jane: It’s practical because it stops you from relying on assumptions about transportability that aren't actually supported by the data structure.
Lu: The paper shows how this unified likelihood structure allows for joint modeling of individual and aggregate data, which is what changes how we think about evidence integration in complex settings.
Meng: For deployment, it means we can be more precise when we specify exactly how much adjustment is needed for a specific patient group using the g-computation framework.
Tom: It’s a step up from just getting one marginal effect and hoping it applies everywhere.
Jane: And they are setting the stage for next steps by showing exactly where the assumptions break down and what we need to measure to fix those breaks.
Conor Chandler, Jack Ishak
PPD, Thermo Fisher Scientific
stat.ME, stat.AP
Submitted: 2026-06-18
Updated: 2026-11-06
Comments: 23 pages (excluding supplementary material), 5 figures
Code: https://github.com/choxos/mlumr
License: http://creativecommons.org/licenses/by/4.0/
Importance score: 83/100
The gist: Unanchored indirect treatment comparisons using multilevel unanchored meta-regression (ML-UMR) are proposed as a Bayesian outcome-regression framework to synthesize individual patient data and…
Key concepts
- Multilevel Unanchored Meta-Regression (MLUMR)
- A Bayesian method that jointly models individual patient data and aggregate study data within a single likelihood. It is used to synthesize evidence from disconnected studies without a network structure, enabling the estimation of treatment-specific outcomes and both marginal and conditional effects across various treatments.
- Identification vs. Transportability
- Identification refers to the strong structural assumptions needed for valid statistical inference, such as no unmeasured confounding. Transportability is the process of using these estimates to adjust or standardize treatment effects so they can be accurately applied to a specific target population.
- Population-Adjusted Indirect Comparisons (PAICs)
- The core goal is to compare treatments indirectly when direct comparisons are impossible. MLUMR achieves this by integrating the outcome model over the covariate distribution of a target population, yielding estimates relevant to that specific group.
- Quantitative Bias Analysis (QBA)
- A future research direction where analysts quantify how much unmeasured prognostic factors or effect modifiers would need to change to significantly alter the study's conclusions. This helps assess the robustness of inferences made under strong identification assumptions.
Terminology
Summary
Unanchored indirect treatment comparisons using multilevel unanchored meta-regression (ML-UMR) are proposed as a Bayesian outcome-regression framework to synthesize individual patient data and aggregate data from fully disconnected evidence. p. 0 Existing populationadjusted indirect comparison methods, including matching-adjusted indirect comparison (MAIC) and simulated
treatment comparison (STC), are generally limited to pairwise settings and typically estimate marginal effects in
the comparator study population, which may differ from the decision-relevant target population. We propose multilevel unanchored meta-regression (ML-UMR), a Bayesian outcome-regression framework
for synthesizing individual patient data and aggregate data from fully disconnected evidence. We propose multilevel unanchored meta-regression (ML-UMR), a Bayesian outcome-regression framework
for synthesizing individual patient data and aggregate data from fully disconnected evidence. ML-UMR extends
multilevel network meta-regression to unanchored settings by jointly modeling individual- and aggregate-level data
within a unified likelihood and linking aggregate outcomes through marginalization over study-specific covariate
distributions, enabling estimation of treatment-specific outcomes and both marginal and conditional effects across
multiple treatments, studies, and target populations.Where the paper says it
Where the paper says it
The core methodology of MLUMR
MLUMR is a Bayesian modeling approach for population-adjusted indirect comparisons (PAICs) of disconnected evidence. It uses the multilevel outcome-regression and marginalization framework of ML-NMR but applies this framework to unanchored comparisons, where the network anchoring structure is absent. p. 1 , single-arm
studies). It uses the multilevel outcome-regression and marginalization framework of ML-NMR but
applies this framework to unanchored comparisons, where the network anchoring structure is absent. Therefore, ML-UMR can be viewed as an adaptation of ML-NMR for the unanchored setting and as a
principled generalization of unanchored STC. ML-UMR jointly models IPD and AgD within a unified
outcome regression framework, and, unlike STC, incorporates aggregate outcomes directly through a
likelihood derived by relating the regression model to the marginal outcome. ML-UMR jointly models IPD and AgD within a unified
outcome regression framework, and, unlike STC, incorporates aggregate outcomes directly through a
likelihood derived by relating the regression model to the marginal outcome. This shared regression
structure enables marginalization over study-specific covariate distributions and transport of treatment
effects to decision-relevant populations.Where the paper says it
Where the paper says it
Where the paper says it
Identification and structural assumptions
Valid inference in unanchored comparisons relies on strong assumptions that must be made explicit within a unified framework. These identification assumptions include:
-
Conditional exchangeability of potential outcomes across studies (No Unmeasured Confounding), meaning that study membership is independent of potential outcomes conditional on baseline covariates. p. 1
Where the paper says it
This shared regression structure enables marginalization over study-specific covariate distributions and transport of treatment effects to decision-relevant populations. Identification relies on strong assumptions, including conditional exchangeability of potential outcomes across studies and correct specification of the outcome regression model (see Appendix A).
-
Positivity / Overlap and Extrapolation, requiring sufficient covariate overlap between the target population and the study populations. p. 1
Where the paper says it
They are typically restricted to pairwise comparisons and often estimate effects in the comparator study population, which may not align with decision-relevant populations in HTA, such as the index study or a jurisdiction-specific population. [19, 23] More fundamentally, they do not provide a unified framework that explicitly separates identification of treatment effects from their transport to target populations, limiting coherent inference across multiple treatments, studies, and decision contexts.
-
Stable Unit Treatment Value Assumption (SUTVA), which requires that the observed outcome equals the potential outcome under the treatment actually received. p. 5
Where the paper says it
However, valid causal interpretation continues to rely on identifying assumptions, including cross-study conditional exchangeability and correct model specification. Shared Prognostic Factor Assumption In the unanchored setting, differences in observed outcomes depend on treatment, population, and study design and cannot be disentangled without structural assumptions on the outcome model.
-
Correct Specification of the Outcome Regression Model, which includes appropriate functional forms and treatment–covariate interactions representing effect modification. p. 1
Where the paper says it
This shared regression structure enables marginalization over study-specific covariate distributions and transport of treatment effects to decision-relevant populations. Identification relies on strong assumptions, including conditional exchangeability of potential outcomes across studies and correct specification of the outcome regression model (see Appendix A).
-
Additional Identification Requirements for ML-UMR: SPFA or Subgroup Identifying Information, where the shared prognostic factor assumption (SPFA) is a common identifying assumption. p. 0
Where the paper says it
As with all unanchored comparisons, valid inference relies on strong and often unverifiable assumptions, including conditional exchangeability, correct specification of the outcome model, and cross-treatment assumptions such as the shared prognostic factor assumption (SPFA). ML-UMR does not lessen these requirements but makes them explicit within a unified framework and facilitates sensitivity analyses.
Transportability to target populations
Transportability is achieved by integrating the estimated outcome model over the covariate distribution of the target population using Bayesian g-computation. Population-average conditional effects are obtained via Bayesian g-computation, and marginal effects require explicit standardization over the covariate distribution of a target population. p. 7 [28]
Transported (population-average) potential outcomes for treatment 𝑘 ∈ {𝐴, 𝐵} are obtained via
Bayesian g-computation[23, 28]:
𝜇𝑘,𝑃e = E𝑋∼𝑃e{𝜃𝑘 (𝑋)}
=
∫
𝑔
−1
𝛼𝑘 + 𝑥
⊤
𝛽𝑘
𝑓𝑃e(𝑥) 𝑑𝑥
(9)
In practice, the integral in (9) is evaluated numerically by averaging model-based predictions over
observed or simulated covariate profiles from the target population at each posterior draw of (𝛼𝑘, 𝛽𝑘). When effects are defined on the linear predictor scale, 𝜂𝑘 (𝑥) = 𝛼𝑘 + 𝑥
⊤ 𝛽𝑘, the population-average
conditional effect for A vs. Transportability is a distinct step from
identification, allowing effects to be evaluated across different decision contexts. Because ML-UMR specifies a hierarchical outcome regression model across treatments, it supports
estimation of treatment-specific outcomes and effects at both the individual and population levels,
including conditional and marginal estimands.Where the paper says it
Where the paper says it
Simulation study performance
A Monte Carlo simulation study compared ML-UMR under SPFA and with SPFA relaxed (via subgroup data) with STC implemented via g-computation and MAIC. The simulations demonstrated that ML-UMR consistently recovered effects in the comparator’s population with minimal bias and near-nominal coverage, even when SPFA was violated and effect modification was strong. p. 0 In simulation studies, ML-UMR produced low bias and nominal coverage for comparator-population effects. Transportability to alternative populations depended critically on identifying assumptions: violations of SPFA
led to bias under strong effect modification, whereas incorporating subgroup information restored near-unbiased
estimation and nominal coverage. Second, we develop a unified multilevel model, ML-UMR, that integrates IPD and AgD from
disconnected evidence and generalizes existing PAIC methods beyond pairwise settings. Third, through
simulation, we demonstrate that in PAICs, comparator-population effects may appear robust under
certain conditions, whereas valid transport to different decision-relevant populations depends critically
on additional identifying assumptions, highlighting the importance of explicitly modeling and testing
these assumptions in practice.Where the paper says it
Where the paper says it
Practical implications for HTA
The distinction between identification and transport is crucial because relative treatment effects are key inputs for cost-effectiveness models (CEMs) used in reimbursement decisions. ML-UMR helps address these challenges by enabling estimation of both conditional and marginal treatment effects directly in decision-relevant populations through standardization, rather than relying on implicit direct transport assumptions. p. 0 ML-UMR extends
multilevel network meta-regression to unanchored settings by jointly modeling individual- and aggregate-level data
within a unified likelihood and linking aggregate outcomes through marginalization over study-specific covariate
distributions, enabling estimation of treatment-specific outcomes and both marginal and conditional effects across
multiple treatments, studies, and target populations. ML-UMR distinguishes assumptions required to identify treatment effects from those required to transport
results to target populations. Keywords: population-adjusted indirect comparison; disconnected; network meta-analysis; health technology assessment;
multilevel network meta-regression
Abstract
Unanchored indirect treatment comparisons using single-arm studies or disconnected evidence are increasingly
used in health technology assessment (HTA) when randomized evidence is unavailable. Existing populationadjusted indirect comparison methods, including matching-adjusted indirect comparison (MAIC) and simulated
treatment comparison (STC), are generally limited to pairwise settings and typically estimate marginal effects in
the comparator study population, which may differ from the decision-relevant target population.Where the paper says it
Where the paper says it
Future research directions
Future work should focus on methods for assessing and quantifying violations of the strong assumptions required for unanchored PAICs. Quantitative bias analysis (QBA) is a promising direction because it allows analysts to quantify how unmeasured prognostic factors or effect modifiers would need to behave to materially change conclusions. A second important area is the development of PAIC methods for partially connected evidence networks where connected randomized controlled trials and other disconnected evidence sources coexist. p. 2 To position ML-UMR relative to existing PAIC methods and to ML-NMR, Table 1 summarizes key
features and differences in evidence structure, modeling approach, estimand, and transportability. Table 1 Positioning ML-UMR relative to STC, MAIC, and ML-NMR
Feature STC MAIC ML-NMR ML-UMR
Primary evidence setting Pairwise, anchored
or unanchored
Pairwise, anchored
or unanchored
Connected
networks, anchored
Fully disjointed
evidence,
unanchored
Modeling approach Outcome regression Weighting Multilevel outcome
regression with
marginalization
Adapts ML-NMR’s
general regression
framework for
evidence without a
network anchor
Target estimand Marginal* Marginal Marginal or conditional; supports
individual- and population-level inference
Source population for outcome
regression or weighting
Index trial (IPD) Index trial (IPD) All IPD and AgD studies
Joint likelihood encompassing all
treatments, studies (IPD and AgD),
subgroups
✗ ✗ ✓
Handles multiple comparators /
studies
✗ ✗ ✓
Transport to any target population** Typically limited to
comparator
Typically limited to
comparator
✓, under anchored
network
assumptions
✓, under
unanchored
identifying
assumptions
Abbreviations: AgD = aggregate data; IPD = individual patient data; MAIC = matching-adjusted indirect comparison; ML-NMR = multilevel
network meta-regression; ML-UMR = multilevel unanchored meta-regression; STC = simulated treatment comparison
*For STC, marginal estimands are usually required to align with the effect or outcome reported for the comparator. Complete pooling assumes no residual heterogeneity between studies evaluating the
same treatment —a strong assumption that may be difficult to justify in practice. Hierarchical models
with study-level random intercepts (i.Where the paper says it
Where the paper says it
References
-
Lumley T. Network meta-analysis for indirect treatment comparisons. p. 0
Stat Med. 2002 Aug 30;21(16):2313-24Where the paper says it
2PPD, Thermo Fisher Scientific, Montreal, Quebec, Canada. Keywords: population-adjusted indirect comparison; disconnected; network meta-analysis; health technology assessment; multilevel network meta-regression Abstract Unanchored indirect treatment comparisons using single-arm studies or disconnected evidence are increasingly used in health technology assessment (HTA) when randomized evidence is unavailable.
-
Phillippo DM, Ades AE, Dias S, Palmer S, Abrams KR, Welton NJ. p. 9
p. 9Where the paper says it
Full formulations are provided in Appendix B. Comparisons of Survival Outcomes Adapting ML-UMR to survival outcomes involves extending the ML-NMR framework for general likelihoods developed by Phillippo et al.
Multilevel network meta-regression for populationadjusted treatment comparisons. p. 0Where the paper says it
Full formulations are provided in Appendix B. Comparisons of Survival Outcomes Adapting ML-UMR to survival outcomes involves extending the ML-NMR framework for general likelihoods developed by Phillippo et al.
Journal of the Royal Statistical Society: Series A. 2020;183(3):1189-210Where the paper says it
Keywords: population-adjusted indirect comparison; disconnected; network meta-analysis; health technology assessment; multilevel network meta-regression Abstract Unanchored indirect treatment comparisons using single-arm studies or disconnected evidence are increasingly used in health technology assessment (HTA) when randomized evidence is unavailable. Existing populationadjusted indirect comparison methods, including matching-adjusted indirect comparison (MAIC) and simulated treatment comparison (STC), are generally limited to pairwise settings and typically estimate marginal effects in the comparator study population, which may differ from the decision-relevant target population.
-
Phillippo DM, Dias S, Ades A, Welton NJ. p. 9
Multilevel network meta-regression for general likelihoods: synthesis of individual and aggregate data with applications to survival analysis. p. 2Where the paper says it
Full formulations are provided in Appendix B. Comparisons of Survival Outcomes Adapting ML-UMR to survival outcomes involves extending the ML-NMR framework for general likelihoods developed by Phillippo et al.
Journal of the Royal Statistical Society Series A: Statistics in Society. 2025:qnaf169Where the paper says it
To position ML-UMR relative to existing PAIC methods and to ML-NMR, Table 1 summarizes key features and differences in evidence structure, modeling approach, estimand, and transportability. Table 1 Positioning ML-UMR relative to STC, MAIC, and ML-NMR Feature STC MAIC ML-NMR ML-UMR Primary evidence setting Pairwise, anchored or unanchored Pairwise, anchored or unanchored Connected networks, anchored Fully disjointed evidence, unanchored Modeling approach Outcome regression Weighting Multilevel outcome regression with marginalization Adapts ML-NMR’s general regression framework for evidence without a network anchor Target estimand Marginal* Marginal Marginal or conditional; supports individual- and population-level inference Source population for outcome regression or weighting Index trial (IPD) Index trial (IPD) All IPD and AgD studies Joint likelihood encompassing all treatments, studies (IPD and AgD), subgroups ✗ ✗ ✓ Handles multiple comparators / studies ✗ ✗ ✓ Transport to any target population** Typically limited to comparator Typically limited to comparator ✓, under anchored network assumptions ✓, under unanchored identifying assumptions Abbreviations: AgD = aggregate data; IPD = individual patient data; MAIC = matching-adjusted indirect comparison; ML-NMR = multilevel network meta-regression; ML-UMR = multilevel unanchored meta-regression; STC = simulated treatment comparison *For STC, marginal estimands are usually required to align with the effect or outcome reported for the comparator.
-
Hogervorst MA, Vreman RA, Mantel-Teeuwisse AK, Goettsch WG. Reported Challenges in Health Technology Assessment of Complex Health Technologies. p. 0
Value Health. p. 0Where the paper says it
2PPD, Thermo Fisher Scientific, Montreal, Quebec, Canada. Keywords: population-adjusted indirect comparison; disconnected; network meta-analysis; health technology assessment; multilevel network meta-regression Abstract Unanchored indirect treatment comparisons using single-arm studies or disconnected evidence are increasingly used in health technology assessment (HTA) when randomized evidence is unavailable.
2022 Jun;25(6):992-1001Where the paper says it
2PPD, Thermo Fisher Scientific, Montreal, Quebec, Canada. Keywords: population-adjusted indirect comparison; disconnected; network meta-analysis; health technology assessment; multilevel network meta-regression Abstract Unanchored indirect treatment comparisons using single-arm studies or disconnected evidence are increasingly used in health technology assessment (HTA) when randomized evidence is unavailable.
-
Phillippo DM, Ades AE, Dias S, Palmer S, Abrams KR, Welton NJ. NICE DSU Technical Support Document 18: Methods for population-adjusted indirect comparisons in submissions to NICE. p. 1
2016Where the paper says it
Despite their increasing use in HTA submissions, such analyses pose considerable challenges: observed outcome differences cannot be attributed to treatment effects rather than population or study design differences without strong, often unverifiable assumptions. [16-19] Current population-adjusted indirect comparison (PAIC) methods for unanchored settings—most notably matching-adjusted indirect comparison (MAIC)[16, 20, 21] and simulated treatment comparison (STC)[16, 22]—are pragmatic tools but have important limitations.
-
Chandler C, Ishak KJ. p. 0
Reframing population-adjusted indirect comparisons as a transportability problem: An estimand-based perspective and implications for health technology assessment. p. 0Where the paper says it
E-mail: conor. chandler@thermofisher.
arXiv preprint arXiv:260217041 [stat. p. 0Where the paper says it
2PPD, Thermo Fisher Scientific, Montreal, Quebec, Canada. Keywords: population-adjusted indirect comparison; disconnected; network meta-analysis; health technology assessment; multilevel network meta-regression Abstract Unanchored indirect treatment comparisons using single-arm studies or disconnected evidence are increasingly used in health technology assessment (HTA) when randomized evidence is unavailable.
ME] 18 Jun 2026Where the paper says it
[7-9] arXiv:2606. 20341v1 [stat.
-
Sofi-Mahmudi A, Chandler C. p. 0
mlumr: Multilevel Unanchored Meta-Regression for Indirect Treatment Comparisons. p. 0Where the paper says it
E-mail: conor. chandler@thermofisher.
R package version 0.1.0 Available from: https://github. p. 1Where the paper says it
xxx xxx (2026), xx:xx 1–33 PREPR INT MANUSCR IPT Anchors Away: Navigating Unanchored Indirect Comparisons with Multilevel Unanchored Meta-Regression (MLUMR) Conor Chandler1 and Jack Ishak2 1PPD, Thermo Fisher Scientific, Waltham, MA, United States. E-mail: conor.
Where the paper says it
2 Chandler et al. In many HTA applications, however, the available evidence is disconnected.
Green — the paper says it, and the page is printed. Red — no passage carries it, so treat that sentence as unverified. The same check runs on your own text: check a summary against its source, $5.
Improvements for AI systems
-
Multilevel unanchored meta-regression (MLUMR) can synthesize individual patient data from fully disconnected evidence, which includes a set of single-arm studies, by jointly modeling individual and aggregate data within a unified likelihood framework. This allows AI systems to estimate treatment specific outcomes and both marginal and conditional effects across multiple treatments, studies, and target populations.
-
The MLUMR framework explicitly formalizes the identification assumptions required for valid inference in unanchored comparisons, clarifying
identification
versustransportability.
This enables AI systems to make explicit decisions about which structural assumptions, such as the shared prognostic factor assumption (SPFA), are necessary for specific conclusions. -
AI systems can perform population-specific standardization to transport treatment effects into decision relevant populations by integrating the estimated outcome model over the covariate distribution of that target population. This moves beyond methods like simulated treatment comparison (STC) which typically estimate marginal effects only in the comparator study population, enabling estimation of
population average conditional treatment effects.
-
The framework supports extension to multiple treatments and multiple studies per treatment through a joint likelihood structure, allowing AI systems to synthesize evidence from various single-arm studies on the same intervention. This capability is crucial for HTA settings where multiple disconnected studies might inform a new therapy.
-
The system can incorporate methods for assessing and quantifying violations of strong assumptions, such as using quantitative bias analysis (QBA) by incorporating bias parameters or simulated unmeasured covariates into the outcome regression modeling and standardization steps. This allows the AI to quantify how unmeasured prognostic factors would need to behave to materially change treatment conclusions.
Abstract
Unanchored indirect treatment comparisons using single-arm evidence are increasingly used in health technology assessment (HTA) when anchored comparisons of randomized evidence are not possible. Existing population-adjusted methods, including matching-adjusted indirect comparison (MAIC) and simulated treatment comparison (STC), are generally limited to pairwise analyses and typically estimate marginal effects in the comparator study population, which may differ from the decision-relevant target population. We propose multilevel unanchored meta-regression for single-arm indirect comparisons (ML-UMR-SA), a Bayesian outcome-regression framework for synthesizing individual patient data and aggregate data from single-arm evidence. ML-UMR-SA respecifies multilevel network meta-regression to pool absolute outcomes rather than relative treatment effects, jointly modeling individual- and aggregate-level data and linking aggregate outcomes through marginalization over study-specific covariate distributions, enabling estimation across multiple treatments, studies, and target populations. ML-UMR-SA distinguishes assumptions required to identify treatment effects from those required to transport results to target populations. Valid inference relies on strong and often unverifiable assumptions, particularly conditional constancy of absolute effects and cross-treatment identifying assumptions such as the shared prognostic factor assumption (SPFA). These requirements are made explicit within a Bayesian modeling framework that facilitates sensitivity analyses. In simulations without unobserved confounding, ML-UMR-SA produced low bias and nominal coverage for comparator-population effects. Transportability to alternative populations depended critically on identifying assumptions, whereas incorporating subgroup information restored near-unbiased estimation and nominal coverage.
Related papers
- Learning Robust Treatment Rules for Censored Data
- Neural Estimation of Summary Statistics for Simulation-Based Inference with Non-Asymptotic Guarantees
- Spectral divide-and-conquer MCMC for long stationary time series
- Improving the Efficiency of Subgroup Analysis in Randomized Controlled Trials with TMLE
- Personalized Federated Vector Autoregression with Personalization Diversity
- Doubly Robust and Efficient Calibration of Prediction Sets for Right-Censored Time-to-Event Outcomes