Does Your Trial Simulator Know What the Drug Does? An Intervention-Blind Test of Interventional Validity on 7,207 Registered Trials
summary
The gist
Patient world models are increasingly proposed as simulators of clinical trials, and recent surveys organize their capabilities as a ladder that rises from temporal prediction…
In short
This study tested how well different AI trial simulators can predict drug effects by measuring their 'interventional skill.' They compared models against an intervention-blind reference to see how much accuracy depends on knowing which treatment was applied. Results showed that language models have measurable interventional skill, suggesting they can better predict drug outcomes than registry-trained simulators.
Key concepts
- Interventional Skill (IS)
- This measures a model's ability to predict results when it knows the specific intervention tested, compared to a baseline model that doesn't know. It quantifies how much accuracy depends on knowing which treatment was applied, operationalizing a key step in testing if a simulator can handle real-world drug testing scenarios.
- Intervention-Blind Reference
- This is a comparison model that does not know which treatment arm was tested during the trial. It serves as a conservative baseline because it already incorporates general knowledge about the class of trials, making the measured interventional skill a lower bound on true performance.
- Counterfactual Rollouts
- This refers to the highest level of prediction capability being tested. It involves simulating what would happen in a trial under different hypothetical conditions or interventions that were not actually tested, which is crucial for making decisions about drug efficacy.
- Registry-Trained Simulators
- These are simulators trained using data from clinical trial registries like ClinicalTrials.gov. The study found these models lacked interventional skill, meaning their predictions didn't significantly improve when given specific intervention information, unlike language models.
Terminology used across episodes
This episode discusses
- Does Your Trial Simulator Know What the Drug Does? An Intervention-Blind Test of Interventional Validity on 7,207 Registered Trials · Paper Radio
- A Gentle Introduction to Conformal Prediction and Distribution-Free Uncertainty Quantification
- Uncertainty Quantification on Clinical Trial Outcome Prediction
- Medical world models in healthcare: capabilities, evidence, and trustworthy clinical translation · Paper Radio
- Doing Great at Estimating CATE? On the Neglected Assumptions in Benchmark Comparisons of Treatment Effect Estimators
- Language Interaction Network for Clinical Trial Approval Estimation
- Selective Classification for Deep Neural Networks
- The Case for Evaluating Causal Models Using Interventional Measures and Empirical Data
- Making the V in VQA Matter: Elevating the Role of Image Understanding in Visual Question Answering
- Annotation Artifacts in Natural Language Inference Data
- World Models
- Can artificial intelligence predict clinical trial outcomes?
- Empirical Analysis of Model Selection for Heterogeneous Causal Effect Estimation
- TwinWeaver: An LLM-Based Foundation Model Framework for Pan-Cancer Digital Twins · Paper Radio
- EHRWorld: A Patient-Centric Medical World Model for Long-Horizon Clinical Trajectories
- RealCause: Realistic Causal Inference Benchmarking
- Validating Causal Inference Methods
- Hypothesis Only Baselines in Natural Language Inference
- Beyond Generative AI: World Models for Clinical Prediction, Counterfactuals, and Planning
- CTP-LLM: Clinical Trial Phase Transition Prediction Using Large Language Models
- Conformalized Quantile Regression
The paper
Does Your Trial Simulator Know What the Drug Does? An Intervention-Blind Test of Interventional Validity on 7,207 Registered Trials · Read on arXiv
Alicem Koyun
Westcliff University
Patient world models are increasingly proposed as simulators of clinical trials, and recent surveys rank their capabilities on a ladder from temporal prediction to counterfactual rollouts. Position on that ladder is currently assigned by reading papers rather than by measurement. We turn the counterfactual rung into a measured quantity. From 30,119 completed phase 2/3 trials with results posted to ClinicalTrials.gov we construct 9,996 audited within-trial contrasts from 7,207 trials, and we score a simulator on how much of its accuracy depends on knowing which intervention was tested. The instrument is an intervention-blind reference: the same model, trained on the same trials, with every intervention-identifying field withheld. Interventional skill is the error the full model removes relative to that reference. On a temporal split (878 test contrasts from 655 trials) a registry-trained gradient-boosting simulator removes a fifth of the error of a trivial baseline, but its interventional skill is-0.12 (95% CI-0.21 to-0.05): withholding the intervention makes it better, and no alternative featurisation, stratum, temporal cut or same-molecule retrieval yields an interval above zero. A frontier language model reading only the registered protocol has interventional skill 0.20 [0.08, 0.31]; smaller and open-weight models sit at the limit of detection. Perturbation tests show the large model uses the intervention as such: swapping the arms reverses the sign of its prediction in 86% of contrasts. The blind reference is itself not drug-blind (a language model recovers the withheld drug class 45% of the time from the blind prompt), so interventional skill is a conservative lower bound. A reliability layer shows that ranking by predicted error lowers it but that calibrated error control does not transfer under temporal shift. Benchmark, code, prompts and per-call model outputs are released.
Transcript
Introduction to the show: ident: Statistics. The day in statistics: methods, theory and the inference under them.
Tom: I'm Tom.
Jane: And I'm Jane, here with Lu, Meng and our in-house large language model, Lalam.
Tom: We're looking at the paper: "Does Your Trial Simulator Know What the Drug Does? An Intervention-Blind Test of Interventional Validity on 7,207 Registered Trials".
Jane: Here's the gist of the paper. Patient world models are increasingly proposed as simulators of clinical trials, and recent surveys organize their capabilities as a ladder that rises from temporal prediction, through action-conditioned prediction, to counterfactual rollouts that can support decisions on Page 1.
Tom: The paper turns the counterfactual rung into a measured quantity by constructing an intervention-blind reference and scoring simulators based on how much of their accuracy depends on knowing which intervention was tested on Page 1.
Jane: Benchmark Construction The construction involves three parts, starting with a benchmark of real counterfactuals from 30,119 completed phase 2/3 trials with results posted to ClinicalTrials.gov on Page 2.
Tom: This benchmark extracts arm-level primary-endpoint results and forms within-trial contrasts, treatment arm minus comparator arm, from 7,207 trials on Page 3.
Paper summary: Tom: We're looking at how they measured this "interventional skill" using seven thousand two hundred seventy registered trials to see if a simulator actually knows what the drug does when you swap out the treatment arm for something else.
Jane: So the authors are turning that counterfactual rollout idea into a measurable number by scoring simulators based on how much their accuracy depends on knowing which intervention was tested on page one >
Lu: They set up a benchmark using nine thousand nine hundred ninety-six within-trial contrasts from seven thousand two hundred seventy trials, focusing on treatment arm minus comparator arm results from page four >
Meng: The definition of interventional skill is that it's the error the full model removes when compared to a blind reference model, which is basically a baseline that doesn't know what treatment was applied >
Tom: So the main finding is that registry-trained simulators have zero interventional skill, meaning they aren't learning anything about the intervention itself, while a large language model reading the protocol showed an interventional skill of zero point two on page four >
Lu: But they also found that when you don't include the posted results, that interventional skill drops to a range between negative zero point one and positive zero point two on page four which is too imprecise to confirm if a model is just memorizing things.
Tom: That tells us we need this kind of measurement because just looking at accuracy isn't enough when you're trying to make decisions on page one of a trial >
Jane: It suggests that having a model that can roll out those counterfactual scenarios is necessary, but it doesn't automatically mean those scenarios are actually grounded in the physics of the drug effect >
Meng: So if you want to trust these simulators for making critical decisions, you have to test them specifically on how they handle the actual intervention, not just their general accuracy.
Meng: From a deployment standpoint, we need to know what breaks at scale, and this benchmark doesn't really simulate that kind of real traffic.
Conclusion: Tom: We're wrapping up this look at these patient world models and what they can actually do when it comes to understanding drug effects from clinical trial data on page two and page three of that paper.
Jane: Right, so we’ve seen how they measured an "interventional skill" using seven thousand two hundred seventy registered trials to see if a simulator actually knows what the drug does when you swap out the treatment arm for something else.
Lu: The authors are basically turning that counterfactual rollout idea into a measurable number by scoring simulators based on how much their accuracy depends on knowing which intervention was tested on page one >
Meng: So what this means for us is that just having a model predict an outcome is not enough; it has to be grounded in understanding the specific action taken during the trial.
Tom: Exactly. They showed that registry-trained simulators had zero interventional skill, while a large language model reading the protocol had an interventional skill of zero point two on page four >
Jane: That means if you swap arms in those tests, that large model reversed its prediction in eighty-six percent of the comparisons on page four >
Jane: It sets up the next big question: if we can measure this skill, what does it take to actually build a simulator that consistently achieves high interventional skill in the real world?
More episodes
- Daily Summary for 2026-11-19
- 2310.07973-Statistical Performance Guarantee for Subgroup Identification with Generic Machine Learning
- 2408.09155-Learning Robust Treatment Rules for Censored Data
- Daily Summary for 2026-11-19
- 2603.23397-Kinetic Langevin Splitting Schemes for Constrained Sampling
- 2606.09906-An information-geometric framework for mapping maximum potential biodiversity
- 2603.27718-Induced replication and the assessment of models
- 1307.0898-Entropy of a Zipfian Distributed Lexicon
- 2406.19974-Generalizing self-normalized importance sampling with couplings
- 2412.10213-Collaborative Optimal Design of Controlled Experiments with Subject Covariates