Reframing Population-Adjusted Indirect Comparisons as a Transportability Problem: An Estimand-Based Perspective and Implications for Health Technology Assessment

Introduction to the show: ident: Statistics. The day in statistics: methods, theory and the inference under them.

Tom: We're looking at the paper: "Reframing Population-Adjusted Indirect Comparisons as a Transportability Problem".

Jane: Here's the gist of the paper. Detailed Summary of "Reframing Population-Adjusted Indirect Comparisons as a Transportability Problem: An Estimand-Based Perspective and Implications for Health Technology Assessment" This paper formalizes the theoretical underpinnings of Population-Adjusted Indirect Comparisons (PAICs) by reframing the core challenge not merely as an adjustment procedure, but as a problem of transportability—determining when an estimated treatment effect learned in one patient population can be validly applied to a different, decision-relevant target population.

Tom: This focus is crucial for Health Technology Assessment (HTA), where PAIC-derived relative effects are routinely used in cost-effectiveness models defined for varied target populations.

Jane: Core Concepts: Collapsibility vs.

Tom: Transportability The paper establishes a critical distinction between two related but distinct concepts: 1.

Title and authors: Tom: Let's talk about that title again, "Reframing Population-Adjusted Indirect Comparisons as a Transportability Problem: An Estimand-Based Perspective and Implications for Health Technology Assessment."

Jane: It’s a big shift because they are reframing PAICs not just as an adjustment technique, but as a problem of transportability.

Lu: They are essentially saying that the real challenge isn't just calculating the adjustment; it's determining when an effect learned in one patient group is actually valid to apply to a different, more relevant target population.

Meng: So instead of thinking about how to clean up the data, we need to think about whether that cleaned-up number can actually travel from study A to decision-making group B.

Tom: That’s the core idea, and it ties directly into health technology assessment where we need evidence that applies beyond just the specific trial population.

Jane: They are using this transportability concept to guide how we use these PAIC-derived relative effects in cost-effectiveness models defined for varied target populations.

Lu: It’s a methodological refinement, focusing on the underlying causal estimand and its relationship with the covariate distribution of different populations.

Meng: So, if you're building a model that needs to predict outcomes for patients outside the trial group, you need to know if your PAIC estimate is transportable or not.

Tom: And the authors show that this concept forces us to look closely at what kind of effect we are actually estimating—marginal versus conditional.

Jane: That distinction is crucial because it dictates whether the underlying mathematical properties support a simple adjustment or require more complex modeling, like those PAIC methods they review.

The paper's summary: Tom: So what’s the actual summary of this paper? It boils down to clarifying the relationship between collapsibility and transportability.

Jane: They summarize that collapsibility is a property that holds within a single population, while transportability is about transferring an estimand across different populations.

Lu: The key finding they highlight is that marginal effects are typically population-dependent because they involve averaging after a nonlinear transformation, unlike conditional effects which might be invariant in indirect comparisons.

Meng: So, if you're looking at a hazard ratio and it’s not collapsible, you should expect it to be population-dependent unless the effect modifiers are shared.

Tom: That leads into the central difficulty: unadjusted transport is often invalid because we don't account for these population differences in how those effects aggregate.

Jane: They show that direct transportability only holds under very narrow conditions, like when there’s no effect modification by covariates whose distributions differ between populations.

Lu: When those conditions aren't met, they suggest using methods like MAICs or STCs to model the conditional transportability instead of relying on simple unadjusted comparisons.

Meng: I need to know how much extra work this modeling adds before I can deploy one of these PAIC methods into a real production environment.

Tom: The paper points out that even when effect modifiers are shared, marginal effects are still generally population-dependent for common measures like odds ratios and hazard ratios.

Jane: So the practical implication is that we need to be transparent about the assumptions we make about those covariates before we claim our PAIC estimate applies broadly.

The paper's improvements: Tom: Now let's look at what improvements the paper suggests for applying these PAIC methods.

Lu: The authors are suggesting that we need to be more rigorous in checking the four criteria—collapsibility, estimand type, shared effect modifier assumption, and scale alignment—before we use any PAIC estimate.

Meng: So the improvement is essentially a checklist: if you don't meet those criteria, you shouldn't blindly apply the comparison.

Tom: And they are suggesting that for non-collapsible measures like hazard ratios or odds ratios, we should be upfront that they are generally population-dependent and not directly transportable.

Jane: They are advocating for a more transparent approach where we explicitly state when an estimate is just populationspecific rather than decision-relevant.

Lu: For the methods, they suggest selecting specific PAIC tools based on what you need to achieve—for instance, Mean Difference estimation might be better if you want direct transportability under SEMA and scale alignment.

Meng: That sounds like we’re moving toward automated model selection for PAIC methods based on the required transportability properties.

Tom: And they are also suggesting that when dealing with network meta-analysis or simulated treatment comparisons, we need to be more careful about how they handle baseline risk heterogeneity between those structures.

Jane: It’s a call for more robust modeling, especially when you're dealing with unanchored comparisons, because standard MAIC or STC estimates often can't be transported beyond the comparator population without further assumptions.

Conclusion: Tom: To wrap up, the main implication is that applying PAIC-derived treatment effects depends on four things: the type of effect modification, whether you target a marginal or conditional estimand, if you assume shared effect modifiers across treatments, and the alignment between scales.

Jane: So we’re ending up with a framework that tells us exactly when to trust an estimate versus when it should be interpreted as populationspecific rather than decision-relevant.

Lu: It emphasizes that for non-collapsible measures like odds ratios or hazard ratios, SEMA alone is not enough to guarantee direct transportability.

Meng: So the practical warning is that if you're relying on SEMA alone, you should flag the risk of introducing bias in Step two transport when moving to a target population <ref:2602.17041#pg1>.

Tom: And we’re suggesting that for non-collapsible measures, using methods like ML-UMR might be a better path forward than just sticking with the standard tools.

Jane: It’s a call for more principled use of indirect evidence in health technology assessment, making sure we aren't applying estimates where they don't belong.

Lu: This paper sets the foundation for how we need to think about these comparisons when they interact with real-world heterogeneity.