Sharp Identification for Regressions with Interval-Observed and Missing Covariates

arXiv:2611.03345 · econ.EM · Submitted 2026-11-02 · Read on arXiv

Listen

Radio episode about this paper

Transcript

Introduction to the show: ident: Economics. The day in economics: theory, mechanisms and the evidence beneath them.

Ruth: We're looking at the paper: "Sharp Identification for Regressions with Interval-Observed and Missing Covariates".

Warren: Here's the gist of the paper. Researchers often estimate regressions when key variables are missing or only observed through intervals, necessitating methods robust to such incomplete data.

Ruth: This paper develops identification and inference techniques for a broad class of conditional moment models, characterizing the sharp identified set—the set of parameter values consistent with the observed data, the regression model, and maintaining conditional moment restrictions—without imposing strict constraints on how incompleteness arises beyond requiring latent realizations to lie within their observed intervals.

Warren: The central object of interest is this sharp identified set, defined as the collection of parameter values for which a single completion of the latent data reproduces the distribution of observed data while respecting reported intervals and satisfying the conditional moment restriction.

Ruth: This set is characterized using an infinite collection of unconditional moments encoded in a single random set, and its identification hinges on whether zero is contained in the Aumann expectation of this random set, which is determined by a support-function criterion evaluated under the observed-data distribution.

Title and authors: Ruth: So, let's talk about the title itself, "Sharp Identification for Regressions with Interval-Observed and Missing Covariates." It immediately tells you that this work is focused on a specific kind of regression problem where we often have missing variables or only see them through intervals.

Warren: And the authors are Martin Fankhauser and Gil Peled. They're tackling the fundamental issue of what parameters we can actually identify when our data isn't exactly what we thought it was to be.

Iris: The title points directly to the core challenge: identification under incomplete information, specifically when those missing pieces come in the form of intervals, which is common in surveys or administrative data.

Ruth: I think that's right. It moves away from just making some assumption about how the missing data comes about, like assuming it's random missingness.

Warren: Instead, they are asking what the maintained regression model can tell us about the parameters of interest when we don't impose extra rules on that process entirely.

Iris: The paper is interested in characterizing this sharp identified set, which is defined as the set of parameter values where a single completion of the latent data reproduces our observed distribution while respecting those reported intervals and satisfying the conditional moment restriction.

Ruth: That definition is key because it sets a very high bar for what we consider to be "identified" in this context. It's about finding parameters that are consistent with the data in one specific way, not just some averaged way.

Warren: And this sharp set is characterized using an infinite collection of unconditional moments encoded within a single random set.

Iris: That's where the complexity comes in, because characterizing this set is hard for two reasons. First, the conditional moment restriction itself is equivalent to infinitely many unconditional moment restrictions that all have to hold at once.

Ruth: And the second reason is that we are dealing with covariates that are themselves incompletely observed, which adds another layer of difficulty to satisfying those joint conditions.

Warren: So they are essentially trying to solve a system of constraints where the constraints themselves involve incomplete information about the variables you're trying to model.

Iris: Right, and existing procedures for missing covariates often check these restrictions separately, which is why they might only deliver outer sets instead of this sharp set.

Ruth: The paper is essentially providing a benchmark against which we can assess how much more informative conclusions we get when we use this sharp identification method versus simpler methods.

The paper's summary: Ruth: To summarize what they found, the main contribution is establishing this sharp identified set Θ I. It’s not just any set of parameters; it’s the set where one single way to fill in the missing data matches our observations while respecting all those interval constraints and moment restrictions.

Warren: And as we discussed, they characterize this by looking at how zero sits within the Aumann expectation of a random set derived from unconditional moments.

Iris: That hinges on whether zero is contained in E Q theta WO, which they figure out using a support-function criterion evaluated under the observed-data distribution.

Ruth: So, if that specific condition holds, then we know the parameter is in the sharp identified set. It’s a very specific mathematical test for identifying those parameters.

Warren: And this leads to their main identification result: a parameter belongs to this sharp identified set if and only if zero is contained in E Q theta WO.

Iris: But they don't stop there; they characterize the restriction itself by reformulating it as a countable collection of unconditional moments embedded in an infinite-dimensional random set.

Ruth: That reformulation is what makes the identification operational for monotone-index models, which are the types of regressions we use most often.

Warren: So, they take that complex restriction and translate it into something usable through support-function inequalities derived from finite sieve approximations.

Iris: And this operationalization allows them to yield Hausdorffconsistent estimators and uniformly valid confidence regions for these monotone-index models.

Ruth: That's the big payoff: we get estimators whose uncertainty bounds are actually guaranteed to be more informative than those from non-sharp methods.

Warren: It connects the theoretical characterization of the sharp set directly to practical, computationally tractable results through these sieve approximations.

The paper's improvements: Ruth: So where does this actually improve things for us, outside of just having a new theoretical characterization? The real improvement is in how we use it for estimation.

Warren: They developed finite-dimensional sieve approximations to make the identification and inference procedures computationally tractable. This means we can actually run these kinds of tests on models like linear, probit, and logit regressions without needing impossibly complex calculations.

Iris: And they proposed an adaptive procedure for estimation that involves selecting informative directions on one sample half, testing on the other side, swapping those roles, and then intersecting the resulting confidence regions.

Ruth: That sounds like a very clever way to build up a confidence region by combining results from different parts of the data.

Warren: And they claim this new procedure maintains approximately nominal coverage even when we have outcome-dependent censoring in our data.

Iris: That's a crucial detail because it means we don't lose our statistical guarantees just because our censoring is complex and depends on the outcome itself.

Ruth: And empirically, they showed that in a multiple price list setting, accounting for those survey intervals increased the width of the confidence set by about twenty-seven percent relative to just using the midpoint benchmark.

Warren: That twenty-seven percent increase suggests that we should be much more careful about ignoring those survey intervals; modest data limitations can really affect our substantive conclusions.

Iris: So, in terms of measurement precision, they show that accounting for these intervals leads to wider confidence sets, which is a necessary caution for anyone using this framework.

Conclusion: Ruth: So, wrapping up on "Sharp Identification for Regressions with Interval-Observed and Missing Covariates," the main implication is that this framework provides a rigorous worst-case benchmark for conditional moment equality models.

Warren: It sets a solid standard against which we can compare stronger identification assumptions and imputation procedures we might use in practice.

Iris: The paper concludes by showing how this framework operationalizes the conditional moment restriction through support-function inequalities, yielding Hausdorffconsistent estimators and uniformly valid confidence regions for monotone-index models.

Ruth: It gives us a concrete way to get those uniform validity guarantees when dealing with these common regression types using standard tools.

Warren: And they show that the identification result is so powerful because it yields substantially tighter confidence regions than non-sharp alternatives, even when data is incomplete.

Iris: I just want to add that the framework allows us to perform sensitivity exercises to quantify the value of more precise measurement, like how much wider our confidence sets get with interval information.

Ruth: That's a practical application; it guides future data collection strategies by showing exactly how much more informative our conclusions become if we capture those intervals.

Warren: So, this paper gives us a way to handle missing or interval-observed variables in regression without making overly strong assumptions about the process generating that missing information.

Iris: It’s a solid piece of work because it takes a difficult theoretical concept and makes it operational for real econometric models like linear, probit, and logit regressions.

Martin Fankhauser, Gil Peled

Bocconi University · Cornell University

econ.EM

Submitted: 2026-11-02

Updated: 2026-11-03

Comments: corrected typo in title

License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/

Importance score: 91/100

The gist: Researchers often estimate regressions when key variables are missing or only observed through intervals, necessitating methods robust to such incomplete data.

Key concepts

Sharp Identified Set ($ heta^*$ I)
This is the specific set of parameter values where a single way to complete missing data reproduces the observed results while respecting reported intervals and conditional moment restrictions. It defines the most precise set of parameters consistent with all available information.
Aumann Expectation ($E[Q_ heta(WO)])$
This is a mathematical tool used to determine if zero is contained within the sharp identified set. It relies on an infinite collection of unconditional moments encoded in a random set. If zero is included in this expectation, the parameter belongs to the sharp identified set.
Hausdorff-Consistent Estimators
These are estimators derived from finite sieve approximations that ensure uniformly valid confidence regions for monotone-index models (like linear or logit regressions). They provide reliable uncertainty bounds even when dealing with data limitations.
Finite-Dimensional Sieve Approximations
This is a computational technique used to make the complex identification problem tractable. It involves using finite subsets of the data to approximate the infinite-dimensional constraints, allowing for practical estimation procedures.

Summary

Researchers often estimate regressions when key variables are missing or only observed through intervals, necessitating methods robust to such incomplete data. p. 0 This paper develops identification and inference techniques for a broad class of conditional moment models, characterizing the sharp identified set—the set of parameter values consistent with the observed data, the regression model, and maintaining conditional moment restrictions—without imposing strict constraints on how incompleteness arises beyond requiring latent realizations to lie within their observed intervals. p. 0 The central object of interest is this sharp identified set, defined as the collection of parameter values for which a single completion of the latent data reproduces the distribution of observed data while respecting reported intervals and satisfying the conditional moment restriction. p. 2 This set is characterized using an infinite collection of unconditional moments encoded in a single random set, and its identification hinges on whether zero is contained in the Aumann expectation of this random set, which is determined by a support-function criterion evaluated under the observed-data distribution. p. 2 The main identification result states that a parameter belongs to this sharp identified set if and only if zero is contained in E[Q theta(WO)]. p. 2

For computational tractability, the paper develops estimation and inference procedures using finite-dimensional sieve approximations. p. 6 A proposed adaptive procedure involves selecting informative directions on one sample half, testing on the other, swapping roles, and intersecting the resulting confidence regions. p. 3 Simulations demonstrate that conventional approaches can gain precision without increasing reliability; this new procedure maintains approximately nominal coverage under outcome-dependent censoring. p. 3 Empirical applications in a multiple-price-list setting show that accounting for survey intervals increases confidence-set width by about 27% relative to the midpoint benchmark, indicating that modest data limitations can significantly affect substantive conclusions. The paper concludes that conditional moment equality models are central to empirical economics, providing a worst-case benchmark against which stronger identifying assumptions and imputation procedures can be assessed. The identification result reformulates the conditional moment restriction as a countable collection of unconditional moments embedded in an infinite-dimensional random set, and this characterization is operationalized via support-function inequalities derived from finite sieve approximations, yielding Hausdorff-consistent estimators and uniformly valid confidence regions for monotone-index models like linear, probit, and logit regressions.

Green — the paper says it, and the page is printed. Red — no passage carries it, so treat that sentence as unverified. The same check runs on your own text: check a summary against its source, $5.

Improvements for AI systems

  1. Sharp Identification for Regressions with Interval-Observed and Missing Covariates allows AI systems to characterize a sharp identified set theta star I, which is the set of parameter values for which a single completion of the latent data reproduces the distribution of the observed data, respects the reported intervals, and satisfies the conditional moment restriction. This provides a robust benchmark against which other identification methods can be assessed.

  2. It enables uniformly valid confidence regions for parameter estimation by establishing Hausdorffconsistent estimation, ensuring that the confidence regions remain substantially more informative than non-sharp alternatives. This means AI systems can generate more reliable uncertainty bounds when dealing with incomplete data.

  3. The paper provides computationally tractable implementations for common regression models, such as linear, probit, and logit regressions, by reformulating the identification problem into an exact linear programming representation for monotone-index models. This allows AI systems to perform estimation and inference using standard solvers via a nested minimax problem.

  4. The framework supports inference using many-moment procedures by constructing sample based test statistics like T AS n, which can be used with bootstrap methods to construct confidence sets CSAS n, achieving coverage guarantees that are uniformly valid over all null pairs (theta, P) in F.

  5. AI systems can perform sensitivity exercises to quantify the value of more precise measurement. For example, the application demonstrates that accounting for the intervals inherent in the MPL design increases confidence-set width by approximately 27% relative to the midpoint benchmark, guiding future data collection strategies.

Sources

Related papers