Finite Sample Inference in Incomplete Models

summary

The gist

Finite-sample inference in incomplete models proposes confidence regions for parameters of incomplete models with exact coverage in finite samples Our proposed procedure is based on a new test…

In short

The paper proposes a method for finite-sample inference in incomplete models, where exact coverage is achieved even with limited data. It uses a new test statistic based on an optimal-transport characterization of data/model compatibility, relying on simulations of latent variables. This provides parameter-free critical values and avoids asymptotic approximations.

Key concepts

Incomplete Structural Models
These models are incomplete because the model structure allows for multiple possible outcomes due to factors like multiple equilibria in games or unobserved heterogeneity. Incompleteness means that more than one model parameter value could explain the observed data, leading to partial identification.
Optimal-Transport Characterization
This is a method used to construct a test statistic by solving a discrete optimal-transport problem, which is a specific type of linear programming problem. It characterizes how well the observed data aligns with the model structure.
Finite-Sample Validity and Exactness
The proposed confidence region has exact coverage in finite samples because the test statistic and its simulated counterpart first-order stochastically dominate each other. This means that for sharp identified parameters, a true data-generating process can be constructed where the coverage probability is guaranteed to meet the nominal level.

Terminology used across episodes

This episode discusses

The paper

Finite Sample Inference in Incomplete Models · Read on arXiv

Transcript

Introduction to the show: ident: Economics. The day in economics: theory, mechanisms and the evidence beneath them.

Ruth: We're looking at the paper: "Finite Sample Inference in Incomplete Models".

Warren: Here's the gist of the paper. Finite-sample inference in incomplete models proposes confidence regions for parameters of incomplete models with exact coverage in finite samples Our proposed procedure is based on a new test statistic that generalizes Monte Carlo tests to incomplete models and relies on simulation draws from the distribution of latent variables.

Ruth: Theoretical Framework Incomplete structural models are called incomplete because the model structure predicts a set of possible values for the outcome variables, and incompleteness arises because of multiple equilibria in games, unobserved heterogeneity in choice sets in limited attention models, interval predictions in auctions, and unknown sample selection mechanisms.

Warren: The procedure proposed applies to parametric incomplete structural models where both the support restriction and the distribution of unobserved heterogeneity are known up to a finite-dimensional parameter vector.

Ruth: Model incompleteness generally leads to partial identification, where more than one value of the model parameter could have given rise to the true data-generating process for the observed variables.

Paper summary: Ruth: To wrap up, "Finite Sample Inference in Incomplete Models" by Lixiong Li and Marc Henry proposes a confidence region method that gives exact coverage for incomplete models even with finite samples.

Warren: They achieve this by using a test statistic derived from an optimal transport formulation of the model structure, which they compute using solutions to discrete linear programming problems.

Iris: The key is that both the test statistic and its critical values rely on simulation draws from the distribution of latent variables, which allows them to achieve finite-sample valid coverage because one statistic first order stochastically dominates the other.

Ruth: They also included a fast preliminary search method using a parameter-free critical value, which avoids those common asymptotic approximations.

Warren: The paper applies this to airline entry and price competition data, showing that their procedure is more efficient than some existing methods in terms of size and power.

Iris: Their main limitation is that this approach is only for parametric incomplete structural models where both the support restriction and the distribution of unobserved heterogeneity are known up to a finite-dimensional parameter vector.

Ruth: So, in simple terms, it’s a method for getting reliable results from complex economic models when you don't have an infinite amount of data or perfect information about everything.

Conclusion: Ruth: So we've been talking about how this paper tackles getting reliable answers from models that don't have all the data or all the information they need, and now we need to talk about what this specific work is actually called and who wrote it.

Warren: It’s called "Finite Sample Inference in Incomplete Models," written by Lixiong Li and Marc Henry.

Iris: What that title tells you right away is the focus here—they're looking at how you can make inferences when the model itself is incomplete, meaning some parts of what’s happening are just hidden or we don't see them directly.

Ruth: Exactly. And what this paper does, in plain terms, is it proposes a new way to build confidence regions for parameters in these complex models that actually works even when you only have a finite sample size.

Warren: It’s not about getting perfect results with infinite data anymore; it’s about making sure the results you get with what you *do* have are actually correct.

Iris: The big idea is they use a specific test statistic, which they build from optimal transport theory—that's a fancy way of saying they’re looking at the best possible way to match the data to their incomplete model structure.

Ruth: And the crucial part for us is that this method has exact coverage in finite samples. That means if you use it, you can trust the confidence region because it actually covers your true parameter value with a certain probability, and that probability doesn't depend on how much data you have in the long run.

Warren: So what does this mean for us running models? It cuts out a lot of the messy stuff they usually have to deal with, like needing huge amounts of data just to get an idea of where your estimate is going.

Iris: And because it avoids those asymptotic approximations, it's much more practical for real-world application. It’s about getting real answers without having to guess how big the sample needs to be before you can trust your results.

Ruth: That leads us right into the next part of our conversation—how this approach actually compares to the other methods out there that people are currently using for these kinds of problems.

More episodes

← Home