Testing Exclusion and Shape Restrictions in Potential Outcomes Models

summary

The gist

Exclusion and shape restrictions are central to defining causal effects and interpreting estimates in potential outcomes models…

In short

This work develops a framework using a graph representation to test exclusion and shape restrictions in potential outcomes models. It provides necessary and sufficient conditions for whether a valid probability distribution of counterfactual responses exists, offering a unified method to derive all observable implications from the model's assumptions.

Key concepts

Potential Response Function
This is the vector of all possible outcomes ($\mathbf{R}^*$) that could occur for every possible input ($x$). It represents what would have happened under different scenarios, such as different treatments or exposures, before any actual observation occurred.
Graph-Based Representation
The model's compatibility structure is encoded in a graph where vertices represent specific potential outcomes. If two vertices are disconnected, it means the corresponding outcomes cannot happen together under the model's assumptions.
Maximal Independent Set (MIS)
An MIS is a set of vertices in the graph where no two vertices are connected by an edge. Theorem 1 shows that for a valid probability distribution to exist, specific inequalities involving the probabilities of outcomes within such sets must hold.
Regular Support Restrictions
This assumption simplifies the analysis by requiring the graph to be perfect and ensuring that every maximal clique corresponds exactly to a single possible support point in the potential response space.

Terminology used across episodes

This episode discusses

The paper

Testing Exclusion and Shape Restrictions in Potential Outcomes Models · Read on arXiv

Boston University · University of Chicago

Transcript

Introduction to the show: ident: Economics. The day in economics: theory, mechanisms and the evidence beneath them.

Ruth: I'm Ruth.

Warren: And I'm Warren, here with Iris.

Ruth: We're looking at the paper: "Testing Exclusion and Shape Restrictions in Potential Outcomes Models".

Warren: Here's the gist of the paper. Exclusion and shape restrictions are central to defining causal effects and interpreting estimates in potential outcomes models, where this paper develops a general framework for characterizing sharp testable implications of general support restrictions on potential response functions using a novel graph-based representation of the model.

Ruth: This framework offers a unified, constructive method for deriving all observable implications arising from the modeling assumptions.

Warren: The observed data involves an exogenous input Z in Z (e.g., instruments or treatments) and an endogenous response R in R, which may encompass endogenous treatments, mediators, or outcomes.

Ruth: The model is defined by the potential response vector R* = (R*(x)) x in X in RX, indexed by counterfactual inputs x in X, and a known mapping T: RX times Z to R such that the observed response satisfies R = T(R*, Z).

Paper summary: Ruth: To start, this paper, Testing Exclusion and Shape Restrictions in Potential Outcomes Models, sets out to develop a general framework for characterizing sharp testable implications arising from general support restrictions on potential response functions using a novel graph-based representation of the model.

Warren: Essentially, they are taking assumptions about exclusion and shape restrictions in potential outcomes models—things we use to define causal effects—and turning them into something we can actually test with data.

Iris: The core claim is that this framework provides a unified and constructive method for deriving all observable implications of the modeling assumptions. They illustrate this approach in several popular settings, including instrumental variables, treatment selection, mediation, and interference.

Ruth: They focus on how the observed data comes from an exogenous input Z—say an instrument or a treatment—and an endogenous response R that depends on potential outcomes R star. The model is defined by the potential response vector R star indexed by counterfactual inputs X and a known mapping T that links it to the observed response.

Warren: The paper introduces a graph where vertices represent these potential responses combined with the input Z, and if two vertices are disconnected in this graph, it means those two events cannot happen jointly under the modeling assumptions.

Iris: That graph structure is crucial because it encodes the compatibility structure of the model, which helps determine if a joint distribution of potential outcomes that matches our observed data can actually exist.

Ruth: The theoretical results establish necessary and sufficient conditions for that joint distribution to exist, with theorem one stating that for any maximal independent set in the potential response graph, an inequality involving the probability of observing those responses is necessary.

Warren: Then theorem two broadens this, saying that for any subset of vertices you pick, there's a corresponding inequality involving lambda G and the size of that subset.

Iris: And under assumption three, which requires the graph to be perfect and every maximal clique to correspond to a specific support point, those inequalities from theorem one become sharp. This makes it constructive.

Ruth: It’s a unified approach that allows practitioners to empirically assess common modeling assumptions in a very broad class of potential outcome models, moving beyond case-by-case testing.

Conclusion: Warren: So what does this paper mean for us when we look at the title, Testing Exclusion and Shape Restrictions in Potential Outcomes Models, and who did the authors on it? It’s about giving us a general tool to test those fundamental modeling assumptions.

Ruth: It means we can move past just testing IV validity or mediation in isolation and start using this framework to see how these restrictions interact across different models systematically.

Iris: The implication is that practitioners gain a constructive way to derive all the observable implications stemming from their assumptions, which is a big step toward robust inference in causal modeling.

Warren: It’s about turning abstract modeling constraints into concrete, testable conditions that we can check against our empirical data using this graph theory approach.

Ruth: Basically, it gives us a way to rigorously assess the validity of the structure of our potential response functions without having to test every single possible scenario individually.

More episodes

← Home