Causal inference for N-of-1 trials
Listen
Radio episode about this paper
Transcript
Introduction to the show: ident: Statistics. The day in statistics: methods, theory and the inference under them.
Tom: We're looking at the paper: "Causal inference for N-of-1 trials".
Jane: Here's the gist of the paper. The work presents an explicit causal framework for analyzing N-of-1 trials, formalizing intuitive claims from existing literature by focusing on causal inference from a single trial.
Tom: The core estimand defined is the conditional average treatment effect (CATE), denoted as U-CAT E k(u), which represents the average treatment effect conditional on an individual-specific variable U.
Jane: The authors define the individual causal effect for participant i at time k as ICE i,k = Y a k bar=1i - Y a k bar=0i.
Tom: The CATE is formally defined as U-CAT E k(u) = E(Y a k bar=1kkU = u) - E(Y a k bar=0kkU = u).
Paper summary: Tom: So we're looking at this paper called Causal inference for N-of-one trials <ref:2406.10360#pg1,Causal inference for N-of-1 trials>. The main idea they're pushing is using a formal causal framework to make sense of these N-of-one studies, which are those single trial designs that look at one person in a crossover setting <ref:2406.10360#pg1>. They want to formalize the intuitive claims people have been making about these trials by focusing on causal inference from just one trial.
Jane: That sounds really practical for personalized medicine because it moves past just knowing if a treatment works generally in a group and starts looking at what happens to an individual, which is exactly what people are trying to do with these single-case designs. What’s the core thing they define?
Lu: They define this conditional average treatment effect called the U-CATE, which represents the average effect conditional on some individual-specific variable they call U. This variable U is what makes it so specific to that person, and that’s where we get the target for this analysis.
Meng: So it’s not just one average effect for everyone; it’s trying to isolate the treatment effect for a specific type of person defined by some characteristic they're tracking. That sounds like a big step in moving from population averages to actual patient-specific decisions.
Lalam: And they introduce another thing, the population-level causal effect, which is basically the difference between what happens if you always treat versus if you never treat across the whole group, which is called ACE. This gives context to that individual effect.
Tom: So essentially they're building a formal way to look at N-of-one trials by defining these specific effects and setting up the conditions needed to actually estimate them <ref:2406.10360#pg1>. It matters because right now, interpreting these results can be pretty messy, depending on what assumptions you start with.
Jane: Right, so the paper is laying out what assumptions you need for identification—meaning how you can actually calculate those U-CATEs—and it shows how different models lead to different estimation approaches. It’s a guide for researchers trying to pull meaningful info out of these single-subject studies without getting lost in the weeds.
Lu: They show that under a basic data generating process with strong conditional stationarity, the estimator for that U-CATE is approximately normal, and its mean is related to some term tau u sub i, where tau depends on the individual variable u sub i and something called z sub i. The variance involves terms related to the proportion of treated time points alpha and different noise variances.
Tom: Okay, so for a simple scenario, they give us a clear statistical shape for the estimate—it’s almost normal with that specific mean structure. That gives us something concrete to test against existing methods if we're looking at straightforward settings.
Paper summary: Jane: But then they move into more complex situations where you have things like carryover effects or trends over time, and they use a longitudinal g-formula for identification in those cases. They define the expected outcome conditional on U equals theta sub k of x bar k, u, and z, which is calculated recursively involving functions of the covariates and past outcomes.
Meng: That recursive structure sounds computationally heavy to run in production environments, but if it allows for identification under realistic assumptions about how things evolve over time, that's where the real utility lies for complex patient journeys.
Lalam: And then they derive the individual causal effect as the difference between those two expected outcomes at time k, specifically theta sub k of one bar k, u, and z minus theta sub k of zero bar k, u, and z. That’s how they get the individual effect from that complex model.
Tom: So if you have a complex system where things change over time based on past results and covariates, this g-formula gives you the exact formula for what you need to calculate the effect for that specific person at that specific time point.
Jane: And they also tackle randomization in Section eight, pointing out that randomization of the treatment schedule itself isn't strictly necessary for identification and estimation under the assumptions they used in earlier sections. They condition inference on Z, even when Z is fixed to a constant z, although randomization is still useful if you want to infer marginal effects over possible values of Z.
Lu: That means you don't have to perfectly randomize the schedule for identification if you stick strictly to the assumptions they established about how confounding and carryover effects interact. It simplifies things a lot when trying to prove an effect exists.
Meng: From an engineering standpoint, that’s good because it means we don't need perfect trial design if our underlying model assumptions hold up; we can rely on the structure of the data instead of needing perfect experimental control at every stage.
Lalam: The acne symptom data they used as an example really showed how the assumptions about what’s happening in the data generating process dictate which strategy to use. For participant two, under a basic model, they could reject no individual-specific effect for that person while not rejecting it for participant one.
Tom: So the complexity of the underlying process matters; in a simple setup, you can find evidence against an effect for one person while finding some for another, which highlights how important those individual characteristics are.
Paper summary: Jane: When they moved to the more complex model with time-varying covariates and carryover effects, they used a g-computation Monte Carlo simulation algorithm to estimate those individual causal effects. They found that both participants showed a favorable effect of the "always treat" strategy compared to the "never treat" strategy across all time points for participant two, but no favorable effect was observed for participant one.
Meng: A Monte Carlo simulation is computationally intensive; what does that mean for deployment? It suggests that estimating these individual effects in high-dimensional, complex scenarios will require a lot of computation time before you can get a reliable estimate back to the user.
Lu: But they also showed that the mean of those estimated individual causal effects was a consistent estimator for the population-level effect, which is ACE, when you aggregate many N-of-one trials together <ref:2406.10360#pg1>. That’s a nice consistency result for scaling up from single trials.
Tom: So even with all that complexity, if we pool enough data from these individual studies, the average of those specific effects converges to the expected outcome under the always treat versus never treat strategy across a whole population. That gives us a way to generalize insights.
Jane: They also explored adjusting for unobserved time trends using smooth functions of time or latent state models, and under certain assumptions about that function of time, they showed that U-CATE can be identified via a g-formula conditioned on that function rather than an unmeasured covariate. They also showed ACE is constant over time under those conditions.
Meng: Conditioning on a smooth function of time instead of trying to measure every single hidden variable sounds much more tractable for real-world data where we don't know everything about the patient’s state at every moment.
Lalam: The paper really ends by emphasizing that you have to be explicit about your assumptions regarding the data generating process when you analyze N-of-one trials, and they commit to a frequentist statistical framework based on superpopulation inference for their main results <ref:2406.10360#pg1>. But they also flag that for guiding treatment decisions after a study is finished, you still need those stationarity assumptions to hold true.
Tom: It's a solid piece of work because it takes these intuitively appealing N-of-one designs and puts them on the causal inference map by giving us formal tools, even if you have to be very careful about the underlying assumptions you start with <ref:2406.10360#pg1>.
Jane: And for anyone looking at personalized medicine, this paper gives them a framework to translate those single patient observations into actionable information about what treatment might do for that specific person. We need to keep an eye on how these formal tools are applied in the next round of clinical research.
Conclusion: Tom: So this paper, "Causal inference for N-of-one trials," it's about taking those single patient studies and giving them a proper causal framework so we can actually make sense of the results.
Jane: I mean, it’s trying to formalize what people have been guessing about these one-off trial designs by focusing on getting causal inference from just that one trial instead of just looking at averages.
Lu: The authors define this conditional average treatment effect called the U-CATE, which is the average effect you get for a specific person based on some individual characteristic they call U.
Meng: So it’s not just one general effect; they are isolating what happens to an individual based on something unique to them. That sounds like it could really matter for personalized medicine decisions.
Lalam: They also introduce this population-level causal effect called ACE, which is the difference between what you get if you always treat versus never treating across the whole group.
Tom: And they show how different models lead to different ways of estimating these effects, depending on what assumptions you start with about how things change over time.
Jane: They looked at basic data first and found a simple shape for the estimator, like it’s almost normal with a specific mean structure based on some tau value.
Lu: For the trickier models, they use something called a longitudinal g-formula to identify things when you have carryover effects or trends over time.
Meng: That sounds computationally heavy for real deployment, but if it lets them identify the effect under realistic assumptions about how patient states evolve, that’s where the actual utility is.
Lalam: The acne symptom data they used as an example showed how different assumptions about the process dictate which strategy you use for analysis.
Tom: They actually found that aggregating many of these individual effects gives you a consistent estimator for that population effect, ACE across large series of N-of-one trials.
Jane: So if we pool enough of these single studies together, the average of those specific individual effects converges to the expected outcome under the always treat versus never treat strategy for everyone.
Lu: They also showed that you can sometimes identify this U-CATE even if you don't measure every hidden variable by using a g-formula conditioned on a smooth function of time.
Tom: The main point is that you have to be really explicit about your assumptions about the data generating process when analyzing these N-of-one trials.
Jane: And they commit to using a frequentist statistical framework based on superpopulation inference for their main results, but they flag that you still need those stationarity assumptions for guiding treatment decisions after the study is done.
Lalam: It’s a solid piece of work because it puts these intuitively appealing N-of-one designs onto the causal inference map by giving us formal tools.
Tom: It gives researchers a way to translate those single patient observations into actionable information about what treatment might do for that specific person.
Jane: We need to keep an eye on how these formal tools get applied in the next round of clinical research, and what kind of assumptions they actually use in those real-world scenarios.
Hasso Plattner Institute for Digital Engineering · University of Potsdam · Ecole Polytechnique Férale de Lausanne Graduate School of Public Health and Health Policy
stat.ME
Submitted: 2024-06-14
Updated: 2026-11-05
Code: https://github.com/MarcoPic-dot/Causal_
License: http://creativecommons.org/licenses/by/4.0/
Importance score: 87/100
The gist: The work presents an explicit causal framework for analyzing N-of-1 trials, formalizing intuitive claims from existing literature by focusing on causal inference from a single trial.
Key concepts
- U-CAT E_k(u)
- This is the core measure of interest, representing the average treatment effect for an individual conditional on their specific variable U. It compares what happens when that individual is treated versus never treated at time k, averaged across all individuals sharing that same characteristic u.
- ACE_k
- The population-level causal effect measures the difference in expected outcomes between the group that always receives treatment and the group that never receives treatment. It provides a summary of the overall impact of the treatment strategy across a population.
- Longitudinal g-formula
- This is a statistical method used to identify causal effects in complex, time-varying models. It uses observed data from multiple time points to estimate the effect by modeling how outcomes evolve based on past outcomes and covariates.
Terminology
Summary
The work presents an explicit causal framework for analyzing N-of-1 trials, formalizing intuitive claims from existing literature by focusing on causal inference from a single trial. p. 0 While the idea behind N-of-1 trials might seem
simple, analyzing and interpreting N-of-1 trials is not straightforward. Here we ground
N-of-1 trials in a formal causal inference framework and formalize intuitive claims
from the N-of-1 trials literature. Here we ground
N-of-1 trials in a formal causal inference framework and formalize intuitive claims
from the N-of-1 trials literature. We focus on causal inference from a single N-of-1
trial and define a conditional average treatment effect (CATE) that represents a target in this setting, which we call the U-CATE.Where the paper says it
Where the paper says it
The authors define the individual causal effect for participant i at time k as ICE i,k = Y a k bar=1i - Y a k bar=0i. p. 3 The authors described their
assumptions about the data generating process using directed acyclic graphs (DAGs), and
relied on some stationarity assumptions. They proved identifiability of the causal effect
in a sequential randomized experiment under additivity assumptions, assuming that the
causal effect was constant over time. Here we ground
N-of-1 trials in a formal causal inference framework and formalize intuitive claims
from the N-of-1 trials literature. We focus on causal inference from a single N-of-1
trial and define a conditional average treatment effect (CATE) that represents a target in this setting, which we call the U-CATE.Where the paper says it
Where the paper says it
population-level causal effect,
ACE k = E(Y a k bar=1) - E(Y a k bar=0k), contrasting the expected outcome under the always-treated versus never-treated strategies in a population.
Identification and estimation results are presented under different causal models. p. 0 We focus on causal inference from a single N-of-1
trial and define a conditional average treatment effect (CATE) that represents a target in this setting, which we call the U-CATE. We discuss assumptions sufficient for
identification and estimation of the U-CATE under different causal models where the
treatment schedule is assigned at baseline.Where the paper says it
For more complex, realistic models incorporating carryover effects, trends over time, time-varying common causes of the outcome, and outcome-outcome effects (Section 6), identification is achieved using a longitudinal g-formula. p. 0 We also consider
settings where carryover effects, trends over time, time-varying common causes of the
outcome, and outcome-outcome effects are present. In these more complex settings, we
show that a time-varying g-formula identifies the U-CATE under explicit assumptions. Thus, we say that the distribution
of the counterfactual outcome is strongly stationary across time conditionally on U. The
strong stationarity assumption in (6) also implies that the expected conditional counterfactual outcome is constant over time, that is,
E(Y
a1=x
1
| U = u) = E(Y
ak=x
k
| U = u) (7)
holds for every k ∈ {1, . The rest of the manuscript is organized as follows: in Section 1. 2 we discuss previous
research related to our work; in Section 2 we introduce our notation and terminology; in
Section 3 we introduce a “basic” causal model relying on strong assumptions about the
outcome generating process; in Section 4 we discuss causal estimands and introduce an
individual-specific causal effect that may be of interest in N-of-1 trials; and in Section 5 we
present identification and estimation results for the basic causal model.Where the paper says it
Where the paper says it
Where the paper says it
The paper addresses randomization in Section 8 by stating that randomization of the treatment schedule is not necessary for identification and estimation under the assumptions used in Sections 5 and 7. p. 0 We focus on causal inference from a single N-of-1
trial and define a conditional average treatment effect (CATE) that represents a target in this setting, which we call the U-CATE. We discuss assumptions sufficient for
identification and estimation of the U-CATE under different causal models where the
treatment schedule is assigned at baseline. For example,
it has been claimed that N-of-1 trials “do not generally require causal inference methods”
if treatment is randomized [19, 20]. Some work has characterized randomization as a way
to eliminate confounding due to autocorrelation and carryover effects [19, 20], while other
work has highlighted the need to account for autocorrelation and carryover effects even in
randomized N-of-1 trials [21].Where the paper says it
Where the paper says it
The analysis of acne symptom data demonstrates how different assumptions about the data generating process dictate analytical strategies. p. 0 In these more complex settings, we
show that a time-varying g-formula identifies the U-CATE under explicit assumptions. Finally, we analyze data from N-of-1 trials about acne symptoms and show how different assumptions about the data generating process can lead to different analytical
strategies. The rest of the manuscript is organized as follows: in Section 1. 2 we discuss previous
research related to our work; in Section 2 we introduce our notation and terminology; in
Section 3 we introduce a “basic” causal model relying on strong assumptions about the
outcome generating process; in Section 4 we discuss causal estimands and introduce an
individual-specific causal effect that may be of interest in N-of-1 trials; and in Section 5 we
present identification and estimation results for the basic causal model. They formalized the subject-specific effect as a conditional effect, where the conditioning is on
a potentially unobserved and high dimensional subject-specific baseline variable. Assuming
correct model specification and a form of stationarity given the baseline covariate, they
observed that g-computation can be used to consistently estimate subject-specific treatment
effects as observation time increases [27]. Results of a single
N-of-1 trial may not generalize beyond the individual that is studied [4, 6, 8], but series of
N-of-1 trials of distinct individuals can be aggregated and analyzed together to yield efficient
estimates of population average treatment effects [3, 8]. These aggregated N-of-1 trial results
have been informally shown to converge towards the results of a multi-crossover RCT [6] or
a parallel-group RCT [7, 15].Where the paper says it
Where the paper says it
Where the paper says it
always treat
strategy compared to the never treat
strategy across all time points for participant 2, whereas no favorable effect was observed for participant 1. Furthermore, the mean of the estimated individual-specific causal effects was shown to be a consistent estimator for ACE k when aggregating large series of N-of-1 trials. p. 1Where the paper says it
The framework also discusses adjusting for unobserved time trends using smooth functions of time or latent state models, showing that under certain assumptions, U-CAT E k(u) can be identified via a g-formula conditioned on a function of time rather than an unmeasured covariate, and ACE k is shown to be constant over time. The paper concludes by emphasizing the necessity of explicitly representing assumptions about the data generating process when analyzing N-of-1 trials and commits to a frequentist statistical framework based on superpopulation inference, while noting that results for guiding treatment decisions after study completion rely on additional stationarity assumptions. p. 3 [30] developed an alternative
two-stage Bayesian latent structural model approach for the same purpose, using study
treatment randomization as an instrumental variable and assuming randomization only at
the beginning of the treatment periods. In our work, we do not require strong parametric
assumptions for identifiability, and rely on a frequentist framework for inference.Where the paper says it
Green — the paper says it, and the page is printed. Red — no passage carries it, so treat that sentence as unverified. The same check runs on your own text: check a summary against its source, $5.
Improvements for AI systems
-
Improve inference on individual-specific causal effects by using conditional average treatment effect (U-CATE) as a formal estimand, which
represents a target in this setting.
This allows AI systems to tailor treatment decisions to individuals based on their specific characteristics U. -
Develop estimation methods that can handle complex data generating processes, such as those with carryover effects and time trends, by utilizing time varying g-formulas or latent state models like Hidden Markov Models. This enables the AI to produce valid causal estimates even when the
basic scenario
assumptions are violated. -
Create robust statistical tests for individual-specific causal effects using estimators like the plug-in estimator ˆtau i,k and its normal approximation in Equation (13). This allows AI systems to perform simple statistical tests, such as an unpaired t-test, to test the null hypothesis of no individual-specific causal effect.
-
Enhance population-level effect estimation by aggregating series of N-of-1 trials using estimators like the average of ˆtau i across a sample of n individuals, which converges towards the average causal effect ACEk when n goes to infinity. This enables AI systems to estimate population averages similar to those targeted in conventional parallel group RCTs.
-
Implement methods for adjusting for unobserved time trends by incorporating smooth functions of time or latent state models that model the unmeasured variable Lbar, allowing for identification of U-CATE even when underlying forces change over time.
Abstract
The aim of personalized medicine is to tailor treatment decisions to individuals' characteristics. N-of-1 trials are within-person crossover trials that hold the promise of targeting individual-specific effects. While the idea behind N-of-1 trials might seem simple, analyzing and interpreting N-of-1 trials is not straightforward. Here we ground N-of-1 trials in a formal causal inference framework and formalize intuitive claims from the N-of-1 trials literature. We focus on causal inference from a single N-of-1 trial and define a conditional average treatment effect (CATE) that represents a target in this setting, which we call the U-CATE. We discuss assumptions sufficient for identification and estimation of the U-CATE under different causal models where the treatment schedule is assigned at baseline. A simple mean difference is an unbiased, asymptotically normal estimator of the U-CATE in simple settings. We also consider settings where carryover effects, trends over time, time-varying common causes of the outcome, and outcome-outcome effects are present. In these more complex settings, we show that a time-varying g-formula identifies the U-CATE under explicit assumptions. Finally, we analyze data from N-of-1 trials about acne symptoms and show how different assumptions about the data generating process can lead to different analytical strategies.
Sources
- Person as Population: A Longitudinal View of Single-Subject Causal Inference for Analyzing Self-Tracked Health Data
- Model-Twin Randomization (MoTR) for Estimating the Recurring Individual Treatment Effect
- Towards personalized causal inference of medication response in mobile health: an instrumental variable approach for randomized trials with imperfect compliance
- Instrumental Variable Approach to Estimating Individual Causal Effects in N-of-1 Trials: Application to ISTOP Study
- Randomization Inference When N Equals One
- Sample size calculations for n-of-1 trials
- Causal Discovery with Continuous Additive Noise Models
- Multimodal N-of-1 trials: A Novel Personalized Healthcare Design
Related papers
- Learning Robust Treatment Rules for Censored Data
- Neural Estimation of Summary Statistics for Simulation-Based Inference with Non-Asymptotic Guarantees
- Spectral divide-and-conquer MCMC for long stationary time series
- Improving the Efficiency of Subgroup Analysis in Randomized Controlled Trials with TMLE
- Personalized Federated Vector Autoregression with Personalization Diversity
- Doubly Robust and Efficient Calibration of Prediction Sets for Right-Censored Time-to-Event Outcomes