Combining stated and revealed preferences: Matched and unmatched

summary

The gist

Combining stated and revealed preferences allows researchers to correct for endogeneity arising from unobserved heterogeneity by using stated choices to identify this distribution…

In short

The paper combines stated preferences and actual choices to correct for endogeneity caused by unobserved individual heterogeneity. By using stated choices to identify this unobserved factor, researchers can recover causal effects in demand function estimation using actual data. It derives bounds on these causal effects when only matched or unmatched data sets are available.

Key concepts

Endogeneity Correction
This method uses stated preferences, which reflect underlying unobserved traits (heterogeneity), to identify those traits. This allows researchers to adjust their analysis of actual choices so that the resulting estimates reflect true causal effects rather than biased correlations caused by hidden individual differences.
Identification Framework
The framework assumes a binary decision D depends on an endogenous attribute X, influenced by unobserved characteristics η. By modeling how stated preferences relate to this underlying characteristic vector η, the researchers aim to uniquely identify the structural choice function and subsequently recover counterfactual choice parameters.
Data Combination Bounds
These bounds provide rigorous limits on the causal effects when data sets are incomplete or unmatched. They show how much uncertainty remains in estimating demand functions even when combining stated and actual preferences, offering a measure of reliability for the derived causal estimates.

Terminology used across episodes

This episode discusses

The paper

Combining stated and revealed preferences: Matched and unmatched · Read on arXiv

R. Méango, M. Henry, Í MourifiƎ

University of Oxford · Penn State · Washington University in St Louis

Transcript

Introduction to the show: ident: Economics. The day in economics: theory, mechanisms and the evidence beneath them.

Ruth: I'm Ruth.

Warren: And I'm Warren, here with Iris.

Ruth: We're looking at the paper: "Combining stated and revealed preferences".

Warren: Here's the gist of the paper. Combining stated and revealed preferences allows researchers to correct for endogeneity arising from unobserved heterogeneity by using stated choices to identify this distribution, which is crucial when actual and hypothetical choices are observed in unmatched data sets.

Ruth: The key idea is to use stated choices to identify the distribution of individual unobserved heterogeneity, if this unobserved heterogeneity is the source of endogeneity, the researcher can correct for its influence in a demand function estimation using actual choices and recover causal effects.

Warren: Bounds on causal effects are derived in the case where stated choice and actual choices are observed in unmatched data sets, these data combination bounds are of independent interest.

Ruth: Identification Framework The framework posits that agents make a binary decision D based on an endogenous decision relevant attribute X.

Title and authors: Ruth: So we're looking at this paper called "Combining stated and revealed preferences: Matched and unmatched". It tackles how we can use hypothetical choices—what people *say* they would do—to fix a big problem when we only have real choices.

Warren: That big problem is endogeneity, right? When the things people actually choose are all mixed up by some hidden factors, and those hidden factors are what makes them say what they say in the hypothetical scenarios.

Iris: Exactly. The paper proposes using those stated choices to identify the distribution of that unobserved heterogeneity, which is crucial when we have actual and hypothetical choices observed in separate datasets.

Ruth: So if we can figure out that distribution, then we can correct for its influence when we're trying to estimate a demand function using the actual choices and actually recover those causal effects.

Warren: And they go further by deriving bounds on those causal effects even when the stated choice data and the actual choice data are completely unmatched. Those combination bounds are of independent interest to me, because that means we don't need them to be perfectly aligned.

Iris: The core idea hinges on using stated choices to identify the distribution of individual unobserved characteristics, which is a necessary step for correcting endogeneity in demand function estimation using actual choices >

Ruth: That sounds like it’s about using optimal transport theory to find these sharp bounds on the structural function, which is a really clever way to do it.

Warren: It's not just identifying the distribution; they are using those stated choices to recover counterfactual choice parameters, which basically means figuring out what people would have chosen under different conditions >

Iris: And they link this back to average structural function by defining it as the expectation of the choice function over all possible unobserved characteristics, which is a big conceptual step in tying everything together >

Ruth: So what does this mean for us practically? It means we can get more accurate estimates of how much things actually matter in a demand model even when our real data is messy.

Warren: The inference procedure they propose uses a bootstrap method to create one-sided confidence bounds for the upper bound, which helps us quantify how reliable those causal effects are when we only have unmatched data >

Iris: They use this procedure involving quantiles of certain distributions related to the parameter estimate, specifically involving the quantity b prime n and its quantile q over one minus alpha over two >

Ruth: It’s a lot of technical detail there, but essentially it's about getting a statistically sound way to make an inference when you're combining these two different types of data >

Warren: Simulation results show that the coverage rates for the true value of the average structural function are close to one, which is good because we expect that true value to be an interior point in the identified set >

Title and authors: Iris: They also found that those confidence bands are narrow and they get narrower with a larger sample size, which makes sense, but they also showed they shrink a bit with the tuning parameter xi over n >

Ruth: So it’s not just that it works on paper; the simulation experiments give us an idea of how much precision we can actually expect in real-world scenarios >

Warren: The authors suggest this approach is useful beyond just combining stated and revealed preferences, implying these combination bounds have broader applicability to other data integration problems >

Iris: They also point out that the inference procedure is particularly suited for empirical settings where you only have scalar or at most bivariate stated probability reports, which sets some clear boundaries on when to use it >

Ruth: So what's the big picture here? It seems like this framework offers a way to bypass some of the structural assumptions we usually have to make about how stated choices relate to actual choices >

Warren: It lets us correct for endogeneity without having those strong structural assumptions on that relation, which is pretty powerful when you’re dealing with real-world data where things are rarely perfectly clean >

Iris: The key contribution seems to be using the stated choice distribution to identify heterogeneity, which then allows us to recover causal effects in demand function estimation >

Ruth: It connects the world of hypothetical scenarios directly back to the world of what people actually do, making it a more robust way to understand human decisions >

Warren: And they are setting up future work by suggesting they might eventually identify a finite number of latent types from elicited preferences using methods from large factor models and group fixed effects literature >

Iris: That sounds like the next logical step for them, moving from continuous heterogeneity to discrete types in their modeling approach >

Ruth: So, to wrap up on this paper "Combining stated and revealed preferences: Matched and unmatched", it gives us a method to correct for unobserved factors using stated choices, even when our data is mismatched.

Warren: It provides bounds on causal effects derived from the combination of stated and actual choices that are useful in many situations >

Iris: The inference procedure offers a one-sided confidence bound for the average structural function by incorporating exclusion restrictions, which is useful for inferring when you can exclude certain observable characteristics >

Ruth: So, it’s a method that lets us use hypothetical reports to get real causal insights without needing perfect alignment between our two data sources.

Warren: It's a tool for when the data isn't perfectly matched but we still want to know what the actual effects are >

The paper's summary: Ruth: So, to recap, this paper is about using what people say they would do in hypothetical situations—stated preferences—to fix endogeneity problems when you only have real data that doesn't match up perfectly with those hypotheticals >

Warren: Right. The main point is that you can use those stated reports to identify the underlying distribution of unobserved characteristics, and that lets you correct the demand function estimation using your actual choices, which is crucial for getting the right causal effects >

Iris: And what they do really interesting is they derive bounds on those causal effects even when your actual data and stated choice data are totally unmatched. Those combination bounds are a sharp thing >

Ruth: It means we don't need perfect alignment between our two datasets to get some reliable estimates for the average structural function >

Warren: Exactly. That’s the practical implication—you can use these methods in real-world scenarios where your data isn't perfectly clean, and you still get a sense of what actually matters when you look at how people choose >

Iris: The way they do it involves using a bootstrap procedure to get a one-sided confidence bound for the upper bound, which helps quantify how certain you are about those causal effects >

Ruth: It’s not just about getting an estimate; it’s about knowing the range of possibilities for that estimate based on what you observe >

Warren: And they show in their simulations that these confidence bands don't get too wide even when the sample size is small, which suggests this method has some stability >

Iris: But they also pointed out that the procedure works best when you only have scalar or maybe two-way stated probability reports, so it’s not a magic solution for every kind of data collection >

Ruth: True. It’s a tool tailored for specific survey types, but it shows that using stated choice information is a valid way to address endogeneity without needing those big structural assumptions about how the choices relate to each other >

Warren: That makes sense. It gives researchers an extra lever when they're stuck between having real data and not being able to run the model correctly >

Iris: So, this shifts the focus from just matching data perfectly to using stated preferences as a powerful tool for identification, even when that match isn't there >

Ruth: Exactly. And I think it opens up new avenues for how we can use these preference reports in economic modeling across different fields >

The paper's improvements: Tom: So, we’re looking at how they suggest making this whole approach better about combining stated and revealed preferences >

Iris: They propose incorporating exclusion restrictions into their inference procedure to get a one-sided confidence bound for the average structural function >

Ruth: That means they’re saying if you can rule out certain observable characteristics from affecting the outcome on average, you can make a stronger claim about the distribution of those unobserved factors >

Warren: It’s like adding a filter to your data, cutting out stuff that we know doesn't matter for the big picture when we're trying to estimate how much something actually drives demand >

Iris: That filter helps with identification because it tightens up the constraints on what the structural function can be >

Ruth: And from an econometric standpoint, that’s solid. It moves us closer to a more robust inference than just relying on the raw combination of both datasets >

Warren: The numbers suggest this tightening actually makes sense, because if you exclude something irrelevant, your uncertainty should drop too >

Iris: But they also flag that this specific procedure is really best when you’re only dealing with scalar or maybe two-way stated probability reports, which is a limitation on the scope of the improvement >

Ruth: Right. So while it makes the method stronger for those specific data types, it still keeps those same boundaries on how much general applicability it has across all kinds of choice experiments >

Warren: It’s not a universal fix; it’s an optimization for specific data setups, which is always true in applied work >

Iris: So the improvement is less about a new way to handle *any* data and more about making the existing method more precise when you know what kind of reports you have >

Ruth: Exactly. It shows that even within these limitations, there’s room to get sharper, more reliable results from combining these two kinds of information >

Conclusion: Tom: So, to wrap up this discussion on "Combining stated and revealed preferences: Matched and unmatched," the main idea is that using stated choices helps us identify hidden factors, which lets us correct for endogeneity when estimating demand >

Ruth: It's about using what people *say* they would do to fix the problems we run into when we only have real choices, and it lets us recover causal effects even when our data isn't perfectly matched >

Warren: The combination bounds are a sharp thing, so you can get a reliable range for those effects even with messy data >

Iris: And they showed that these bounds are quite tight, which is good because it means the uncertainty in the estimate is actually quite controlled by the sampling interval >

Ruth: It’s not just about getting an estimate; it’s about knowing exactly how much wiggle room you have in your demand function parameters >

Warren: And I think that stability in the bounds is what makes this useful for a quantitative trader, because we can't afford huge uncertainties when making decisions >

Iris: From my econometric side, the identification method relies heavily on those exclusion restrictions to ensure we’re looking at the right variation doing the work >

Ruth: So we've seen how they use stated preferences as an identifier and how they set up a solid framework for inference with this paper >

Warren: It gives us a way to get causal insights without needing those huge structural assumptions about how people actually behave in the market >

Iris: It’s definitely useful for empirical work, though we have to remember that it’s best suited for scalar or maybe two-way stated probability reports >

Ruth: True. So this paper shows how we can use hypothetical choices to get real causal insights without needing perfect alignment between our two data sources >

Warren: It’s a tool for when the data isn't perfectly matched but you still want to know what the actual effects are, and it's got some good numerical grounding >

Iris: So we’re left with this method offering a way to use stated choice information to correct for endogeneity without needing those strong structural assumptions on the relationship between stated and actual choices >

More episodes

← Home