Does Predictive Performance Translate to Causal Performance? Evaluating tabular foundation models as nuisance learners for causal effect estimation
stat.AP, cs.AI, cs.LG, stat.ME, stat.ML
Submitted: 2026-11-08
Updated: 2026-11-08
Code: https://github.com/a-weckstein/Tabular-FM-causal-simulations
Terminology
Sources
- Automatically identifying, counting, and describing wild animals in camera-trap images with deep learning
- Tabular Data: Deep Learning is Not All You Need
- Why do tree-based models still outperform deep learning on tabular data?
- Transformers Can Do Bayesian Inference
- TabPFN-2.5: Advancing the State of the Art in Tabular Foundation Models
- TabPFN: One Model to Rule Them All?
- What Can Transformers Learn In-Context? A Case Study of Simple Function Classes
- Position: The Future of Bayesian Prediction Is Prior-Fitted
- Semiparametric doubly robust targeted double machine learning: a review
- Semiparametric theory and empirical processes in causal inference
- Cross-Fitting and Fast Remainder Rates for Semiparametric Estimation
- TabPFN-3: Technical Report
- Mitra: Mixed Synthetic Priors for Enhancing Tabular Foundation Models
- Investigating Targeting Strategies and Truncation in TMLE for the Average Treatment Effect under Practical Positivity Violations
- CausalPFN: Amortized Causal Effect Estimation via In-Context Learning
- Prior-Data Fitted Networks for Causal Inference: a Simulation Study with Real-World Scenarios
- Use What You Know: Causal Foundation Models with Partial Graphs
- Do-PFN: In-Context Learning for Causal Effect Estimation
- Frequentist Consistency of Prior-Data Fitted Networks for Causal Inference
- TabPFN-Wide: Continued Pre-Training for Extreme Feature Counts
Related papers
- Unraveling time-varying causal effects of multiple exposures: integrating Functional Data Analysis with Multivariable Mendelian Randomization
- Strategic Causal Policy Learning with Manipulable Eligibility
- BayesJudge: Uncertainty-Aware Bayesian Meta-Evaluation of Human and LLM Judgments
- Automating structural reliability analysis with a multi-agent large language model framework
- Improving Minority Population Sampling with BISG Probabilities: Evidence from a Survey of Jewish Americans
- When Do Sports Leagues Stop Being Competitive? Bayesian Detection of Competitive-Balance Eras from Match-Level Data