Causally-interpretable meta-analysis using aggregate data

summary

The gist

Evidence syntheses and meta-analyses are used to inform clinical practice guidelines and health economic evaluations by estimating summary results that integrate treatment effect estimates from…

In short

This method uses aggregate data from randomized trials to estimate average treatment effects in a specific target population. It builds a parametric conditional average treatment effect (CATE) function by learning from trial subgroup results and covariates, allowing researchers to quantify how treatment effects vary across different patient subgroups.

Key concepts

Conditional Average Treatment Effect (CATE)
The CATE is a function that describes how the average treatment effect changes depending on an individual's characteristics. This method tries to learn this function using aggregate trial data, which helps in understanding treatment heterogeneity across different patient groups.
Generalized Method of Moments (GMM)
GMM is a statistical technique used here to estimate the parameters of the CATE function. It works by constructing moment equations based on the observed data and then finding the parameter values that make these moments match, helping to accurately model how treatment effects vary.
Target Population Estimand
This refers to a specific average treatment effect that researchers want to estimate for a defined group of patients, such as heart failure patients. The method aims to connect the results from many different trials back to this specific target group's outcome.
Causal Interpretation
The framework provides a way to draw causal inferences even when individual patient data from trials are missing. It establishes a clear link between trial results and the target population by using assumptions that ensure the resulting estimate is causally interpretable.

Terminology used across episodes

This episode discusses

The paper

Causally-interpretable meta-analysis using aggregate data · Read on arXiv

University of Groningen · University Medical Center Utrecht · Groningen Research Institute of Pharmacy, University of Groningen · Dutch National Institute of Public Health and the Environment (RIVM) · Harvard T.H. Chan School of Public Health

Transcript

Introduction to the show: ident: Statistics. The day in statistics: methods, theory and the inference under them.

Tom: I'm Tom.

Jane: And I'm Jane, here with Lu, Meng and our in-house large language model, Lalam.

Tom: We're looking at the paper: "Causally-interpretable meta-analysis using aggregate data".

Jane: Here's the gist of the paper. Evidence syntheses and meta-analyses are used to inform clinical practice guidelines and health economic evaluations by estimating summary results that integrate treatment effect estimates from multiple randomized trials The method proposes a new version of CIMA that only requires aggregate data from trials, addressing the limitations of traditional meta-analysis methods while relying only on aggregate data The proposed method leverages trial-reported estimates to build moment equations for identifying and estimating a parametric conditional average treatment effect (CATE) function The identification of the CATE function is achieved by leveraging information from both marginal and one-at-a-time subgroup treatment effects from trials, and descriptive summary statistics of baseline covariates The method involves constructing moment equations to estimate the parameters of a parametric CATE function via the generalized method of moments (GMM) The average treatment effect in a new target population is obtained by marginalizing the CATE function over the target population covariate distribution Identification and Estimation Framework The framework establishes a causal link between trial results and a target-population estimand by learning a parametric approximation to the conditional average treatment effect (CATE) function from aggregate data The method relies on assumptions A1 and A3 to express the target population average treatment effect as E

g(X)S = 0: , where g(x) is the CATE function The true parameter θ0 is identified as the unique element of Θ satisfying Z α(x; η0) g(x; θ) dQ(x) − τ0 = 0J Performance and Application in Simulation A simulation study was conducted to examine the finite-sample behavior of CIMAgD under stylized data-generating mechanisms, comparing it against standard meta-analysis and individual participant data (IPD) benchmarks The method demonstrated good finite-sample performance with coverage ranging from approximately 94% to 97% in the multi-trial setting Clinical Relevance and Decision Making The application of the method to SGLT2 inhibitors in patients with heart failure demonstrated that the proposed method can quantify treatment-effect heterogeneity across clinically relevant subgroups in a new target population The results suggest treatment-effect heterogeneity across clinically relevant subgroups in the target population and show how the proposed method can be used to quantify such heterogeneity for decision-making The approach avoids test-based decisions and directly targets a well-defined estimand for decision-making The proposed method extends causally interpretable evidence synthesis to settings where individual-level trial data are unavailable while retaining a more explicit causal identification and inferential framework The resulting estimator remains grounded in a clearly defined target population and supports standard large-sample inference under the stated assumptions This framework may be particularly useful for clinical decision-making, guideline development, and health technology assessment The method relies on subgroup treatment effects reported by the trials to identify the CATE function In conclusion, we developed a method for estimating average treatment effects in a user-specified target population using aggregate data from randomized trials Appendix Details on Estimator Structure The asymptotic linear representation of the CATE estimator explicitly shows the first-order propagation of uncertainty from multiple data sources The variance estimation involves a plug-in estimator for the sampling variance that accounts for dependencies across different data sources The asymptotic linear representation shows that the first-order uncertainty arises from three components: (1) estimation of the stacked moments using the base distribution Q; (2) estimation of the treatment effects within each trial; and (3) estimation of the exponential-tilting parameters using information from both the trials and the base distribution Appendix Details on Relative Treatment Effects The method can be adapted to estimate indirect treatment comparisons in a target population by using relative treatment effects The indirect comparison estimand is defined as ψ12 ≡ E

Y (2) − Y (1) S = 0: Issa J Dahabreh et al., Toward causally interpretable meta-analysis: transporting inferences from multiple randomized trials to a new target population.

Tom: Epidemiology, 31(3):334–344, 2020a Issa J Dahabreh et al., Study designs for extending causal inferences from a randomized trial to a target population.

Jane: American journal of epidemiology, 190(8):1632–1642, 2021 Issa J Dahabreh et al., Efficient and robust methods for causally interpretable meta-analysis: Transporting inferences from multiple randomized trials to a target population.

Tom: Biometrics, 79(2):1057–1072, 2023 Muthiah Vaduganathan et al., Sglt2 inhibitors in patients with heart failure: a comprehensive meta-analysis of five randomised controlled trials.

Paper summary: Jane: So, to recap the paper "Causally-interpretable meta-analysis using aggregate data", they argue that conventional meta-analyses struggle when there’s a lot of treatment effect heterogeneity because their random-effect assumptions don't hold up in reality >

Tom: Right. The core thesis is that they provide a rigorous framework, CIMA, for specifying and identifying the causal effect in a new target population using only aggregate data from randomized trials >

Lu: They establish how to link the trial results to that target population estimand by learning a parametric approximation of the CATE function from those aggregate statistics >

Meng: The key claim seems to be that you can get causally-interpretable indirect treatment comparisons in the target population, which is useful for guiding clinical decisions >

Lalam: They also establish the asymptotic properties of this estimation procedure, which means they’ve looked at what happens as the number of trials gets really big >

Tom: So it's moving beyond just estimating an average effect across all trials and trying to account for how that average changes depending on where you are in terms of patient characteristics >

Jane: It matters because it offers a way to quantify treatment effect heterogeneity in a new target population without relying on assumptions about the distribution of those effects across trials >

Conclusion: Tom: So, looking at this paper "Causally-interpretable meta-analysis using aggregate data", it’s really about taking evidence from multiple randomized trials and making it causal in a specific group of people >

Jane: The authors are trying to show that this approach keeps the explicit causal identification and inferential framework even when you don't have individual patient trial data available >

Lu: It’s useful because it supports standard large-sample inference under the assumptions they set up, making it applicable for guideline development and health technology assessment >

Meng: From an engineering standpoint, they’ve created a new R package, CIMAgD that you can actually use to implement this methodology >

Lalam: So the paper offers a method for estimating average treatment effects in a user-specified target population using just aggregate data from randomized trials >

More episodes

← Home