Double Machine Learning for Inequality Decompositions: Reference Outcomes, Orthogonal Scores and Limited Overlap
summary
The gist
The paper reformulates the Kitagawa-Oaxaca-Blinder decomposition using potential outcomes and a doubly robust estimator based on double machine learning to avoid common support issues and model…
In short
The paper reformulates inequality decomposition using potential outcomes and a double machine learning approach based on Neyman orthogonality. It introduces an equilibrium reference outcome that avoids common support issues and allows for doubly robust estimation of the unexplained part of mean differences. This method provides stable, precise estimates even when underlying models are misspecified.
Key concepts
- Kitagawa-Oaxaca-Blinder decomposition
- This framework splits the difference in means between two groups into an explained part due to observable characteristics and an unexplained part. It is extended using potential outcomes to show how the reference outcome dictates this decomposition.
- Equilibrium Reference Outcome (r=2)
- This reference outcome is a weighted average of potential outcomes, defined by the proportion of individuals sharing characteristics between groups. Using this specific outcome stabilizes results and removes the need for common support assumptions when identifying unexplained differences.
- Double Machine Learning
- This technique uses Neyman orthogonality and cross-fitting to estimate parameters simultaneously. It provides a doubly robust estimator, meaning it remains accurate even if the models used to estimate nuisance parameters (like outcome or propensity scores) are slightly incorrect.
- Neyman Orthogonality Condition
- This mathematical condition ensures that the estimator derived from machine learning is robust. When applied to the equilibrium reference outcome, this property guarantees that the resulting estimator has good statistical properties and achieves root-n convergence rates.
Terminology used across episodes
This episode discusses
- Double Machine Learning for Inequality Decompositions: Reference Outcomes, Orthogonal Scores and Limited Overlap · Paper Radio
- The Gender Pay Gap Revisited with Big Data: Do Methodological Choices Matter?
The paper
Double Machine Learning for Inequality Decompositions: Reference Outcomes, Orthogonal Scores and Limited Overlap · Read on arXiv
Emmanuel Flachaire, Bertille Picard
Aix-Marseille University · Univ Rennes, Ensai, CNRS, CREST-UMR 9194
Kitagawa-Oaxaca-Blinder decompositions split a gap in mean outcomes between two groups into a part explained by characteristics and an unexplained part. The unexplained part depends on the counterfactual "reference outcome" that individuals would receive if characteristics were valued equally. Several competing references have been proposed, mostly within the linear regression model. We show that the main proposals, namely using the outcome of either group as the reference and the references of Cotton (1988), Reimers (1983) and Neumark (1988), all belong to a single family of mixtures of the two groups' potential outcomes. This separates the choice of target from the choice of estimator, and allows nonparametric estimation by double machine learning. We find that the appropriate orthogonal score depends on the reference: Neumark's propensity-weighted reference requires a pooled regression, while all the others require group-specific regressions. We then show that Neumark's reference avoids both extrapolation and extreme weights under limited overlap. Finally, we discuss in a general setting the shrinkage effect of the unexplained part associated with the choice of Neumark's reference.
Transcript
Introduction to the show: ident: Economics. The day in economics: theory, mechanisms and the evidence beneath them.
Ruth: We're looking at the paper: "Double Machine Learning for Inequality Decompositions".
Warren: Here's the gist of the paper. The paper reformulates the Kitagawa-Oaxaca-Blinder decomposition using potential outcomes and a doubly robust estimator based on double machine learning to avoid common support issues and model misspecification.
Ruth: Decomposition Framework The Kitagawa-Oaxaca-Blinder decomposition splits the difference in means between two groups into an explained part, due to observable factors, and an unexplained part.
Warren: This framework is extended using potential outcomes to highlight the critical role of the reference outcome.
Ruth: The observed difference in means can be decomposed into three parts: ∆rX that can be explained by a different composition in terms of characteristics between both groups, ∆r,1S that is the unexplained advantage of group 1, and −∆r,0S that is the unexplained disadvantage of group 0.
Title and authors: Ruth: So, let's go over who wrote this and what the title actually says. It's "Double Machine Learning for Inequality Decompositions: Reference Outcomes, Orthogonal Scores and Limited Overlap."
Warren: The authors are Emmanuel Flachaire and Bertille Picard. They bring expertise from both econometrics and machine learning, which is exactly what you need when you’re trying to build these kinds of robust decomposition methods.
Iris: I’m interested in the "Orthogonal Scores" part of the title. That suggests they are using a specific mathematical setup to make sure their estimation method is orthogonal to some errors in the models.
Ruth: Right, and "Limited Overlap." That hints at the practical reality—that you can't always have perfect overlap between groups when you try to apply these methods across many characteristics.
Warren: Essentially, this paper proposes a new way to decompose inequalities that handles those complexities better than the old methods. It’s about making sure your estimates for unexplained parts are solid, not just based on simple regression.
Iris: So, what does this mean for the identification part? If you can estimate the unexplained part without needing common support assumptions, that opens up a lot of possibilities for real-world data analysis.
Ruth: It does. The old methods often required strong assumptions about how well your propensity score models fit, and this paper suggests you can relax those requirements by using machine learning to estimate those nuisance parameters.
The paper's summary: Warren: So, in terms of what the paper actually does, they start with the standard Kitagawa-Oaxaca-Blinder decomposition but reformulate it entirely. They use potential outcomes to emphasize how critical that reference outcome choice is for understanding the unexplained part.
Iris: They break down the observed difference into three parts: what you can explain from observable characteristics, plus a part that’s an unexplained advantage for one group, and another part that’s an unexplained disadvantage for the other.
Ruth: And they focus on estimating that last, unexplained piece using their new framework. They use a double machine learning procedure based on Neyman orthogonality to achieve a doubly robust estimator.
Warren: That means if your initial model for the outcome or the propensity score is slightly wrong, this estimator still gives you decent results because it’s designed to be insensitive to those small mistakes.
Iris: They specifically look at an equilibrium reference outcome, defined as a weighted sum of the two potential outcomes where weights depend on how much each group shares characteristics. That seems like a smart way to define a baseline when you have many variables.
Ruth: It’s designed to avoid trimming or extrapolation, which are often necessary in other methods when you try to use many characteristics in the decomposition. They show that this method is quite flexible across different types of data, categorical or continuous.
The paper's improvements: Iris: So what are the main improvements they’re pushing? It seems like the biggest improvement is getting rid of those common support assumptions when estimating the unexplained part.
Warren: Right. They show that you can estimate that difference without having to assume a certain overlap in the data distributions, which is a big deal for real-world datasets where you don't always know the exact boundaries of group membership.
Ruth: And they tackle model misspecification by using machine learning techniques to estimate those complex non-linear functions instead of relying on simple parametric models for every step.
Iris: They use double machine learning, which uses cross-fitting and Neyman orthogonality to ensure the resulting estimator is robust and achieves root n convergence rates, meaning it gets accurate as your data gets bigger.
Warren: It’s designed to be consistent if you correctly specify either the outcome model or the propensity score model, which is what makes it doubly robust. This sounds like a lot of work for an estimation strategy.
Ruth: And they show that using this equilibrium reference outcome, specifically r equals two, leads to more stable and precise results compared to just picking a reference outcome of zero or one. That’s a solid empirical finding they highlight.
Conclusion: Ruth: So to wrap up the paper "Double Machine Learning for Inequality Decompositions: Reference Outcomes, Orthogonal Scores and Limited Overlap," the main point is that using this equilibrium reference outcome allows for a doubly robust estimator with Neyman orthogonality.
Warren: This combination lets researchers estimate the unexplained component without having to rely on common support or simple low-dimensional parametric models. It’s an alternative path to analyzing distributional differences that is much more flexible.
Iris: From my econometric view, it means we have a stronger tool for identifying the causal effects of observable characteristics when those characteristics are complex and numerous. The sensitivity they point out to irrelevant variables is something we have to keep in mind though.
Ruth: That’s right, the authors themselves flag that the decomposition based on this reference outcome can still be sensitive to including irrelevant explanatory variables in your analysis. So researchers need to be careful about what they’re putting into those models.
Warren: It sounds like a powerful tool for people trying to get reliable estimates of inequality components in large datasets, even when the underlying data structure is complicated. That's where this work sits right now.
More episodes
- Daily Summary for 2026-11-19
- 2608.21274-Recommendation Quality and the Concentration of Consumption: Experimental Evidence from Netflix
- 2408.02757-A nonparametric test for diurnal variation in spot correlation processes
- 2306.16393-High-Dimensional Canonical Correlation Analysis
- 2605.17299-Geometric Brownian motion with intermittent entries and exits
- 2607.04753-Fooling Yourself: how narratives shape beliefs
- 2408.14671-Inference on Treatment Effects with Repeatedly Mismeasured High-Dimensional Controls
- 2201.06898-Difference-in-Differences Estimators for Treatments Continuously Distributed at Every Period
- 2501.15307-Influence Functions: A Unified Differentiation-Based Framework
- The day in conversation for 2026-11-19