Work that Counts, and Work that Doesn't: Reconciling Experimental and Observational Labor Supply Elasticities
summary
The gist
Combining a real-effort emoji-counting experiment with platform records, self-reported expectations and recalls, and smartphone screen-time logs…
In short
The study compares how workers react to wage changes in a controlled experiment versus their actual work experience. Findings show behavior differs significantly between the two settings, revealing that attention to realized earnings is key. Workers who accurately track their pay respond similarly in both settings, while recall errors mute responses in real life. This helps reconcile conflicting elasticity estimates and suggests workers are neoclassical regarding expected wages but reference-dependent when deviations are visible.
Key concepts
- Intertemporal Elasticities
- This measures how a worker's future labor supply changes in response to a wage change now. The study found these elasticities are much smaller in real work compared to the experiment, contradicting some economic models. This difference is linked to whether workers pay attention to their earnings.
- Recall Error
- This refers to mistakes made when self-reporting past earnings. Recall error acts as both a source of measurement error and a symptom of inattention. High recall errors are predicted to lead to muted intertemporal elasticity, especially in real work where wage changes might go unnoticed.
- Reference Dependence
- This describes how a worker's response to a wage change depends on their current reference point—what they expect or what they have recently seen. The paper suggests that this dependence is strongest when deviations from expectations are visible, meaning workers react differently based on whether the deviation is salient.
- Uncompensated Elasticities
- These elasticities measure the response to wage changes without considering income effects. The study found these are more stable between the experiment and real work, suggesting that income effects play a negligible role in determining labor supply responses across different settings.
Terminology used across episodes
This episode discusses
- Work that Counts, and Work that Doesn't: Reconciling Experimental and Observational Labor Supply Elasticities · Paper Radio
The paper
Work that Counts, and Work that Doesn't: Reconciling Experimental and Observational Labor Supply Elasticities · Read on arXiv
Mattia Adamo, Michele Cantarella
IMT School for Advanced Studies Lucca · Technical University of Denmark - DTU
Do workers behave the same in experiments as they do in real life? Combining a real-effort emoji-counting experiment with platform records, self-reported expectations and recalls, and smartphone screen-time logs, we compare how the same workers on Prolific respond to wage changes in the experiment and in their actual work. Our results reveal that workers' behavior in experiments is remarkably different from their behavior in real life. In the observational window, in fact, workers respond to expected wage changes just as they do in the experiment, but are much less responsive to unanticipated changes. However, once we condition on recall error in self-reports, we find that behavior in the two windows aligns. Recall error is then both a source of error in self-reported data and the result of a process of inattention that affects effort itself, as workers do not respond to unexpected wage changes that pass unnoticed.
Transcript
Introduction to the show: ident: Economics. The day in economics: theory, mechanisms and the evidence beneath them.
Ruth: We're looking at the paper: "Work that Counts, and Work that Doesn't".
Warren: Here's the gist of the paper. Combining a real-effort emoji-counting experiment with platform records, self-reported expectations and recalls, and smartphone screen-time logs, this study compares how workers on Prolific respond to randomized wage changes in the experiment versus wage variation in their actual work.
Ruth: The results reveal that workers’ behavior in experiments is remarkably different from real life.
Warren: In the observational window, workers respond to expected wage changes just as they do in the experiment, but are much less responsive to unanticipated changes.
Ruth: However, once conditioned on recall error in self-reports, behavior aligns between the two windows.
Title and authors: Ruth: So we're looking at this paper called "Work that Counts, and Work that Doesn't: Reconciling Experimental and Observational Labor Supply Elasticities." It’s by Adamo and Cantarella. Essentially, they’re asking if the way people react to wage changes in a controlled experiment matches how they react in their actual jobs.
Warren: Yeah, they combine an emoji counting experiment with records from platforms like Prolific, plus self-reports and screen time data. They’re comparing how workers change their work when the wage changes randomly in the test versus when it actually changes at work.
Iris: The core finding they present is that workers act very differently in experiments compared to real life. In the observational window, they respond to expected wage changes just like in the experiment, but they are much less responsive to unexpected ones.
Ruth: That’s a big difference because it points directly at how expectations matter when we look at real labor supply decisions. They also find that if you condition on recall error in self-reports, the behavior starts to align between the two windows.
Warren: Recall error being a source of error for self-reported data, but also a sign of inattention, which they argue affects effort itself when unexpected wage changes go unnoticed. That’s an interesting link between measurement and actual behavior.
Iris: What really sticks with me is how the intertemporal elasticities look. In the observational window, they are remarkably muted compared to the experiment, actually smaller than what you'd expect from life-cycle models.
Ruth: And that’s a contradiction because life-cycle models predict that when workers perceive a wage change as transitory relative to their expected path, they work more today. But here, the observational window shows something different.
Warren: They also find that uncompensated elasticities are more stable between the two windows, and they are close to this intertemporal recall-adjusted figure, which suggests there aren't much income effects at play in this comparison.
Iris: That stability is driven by a process called attention to realized earnings. Workers who keep track of their earnings and can recall them accurately respond to wage changes in the observational window just like they do in the experiment.
Ruth: So, it seems that being able to track what you’ve actually earned is what bridges that gap between the two windows of data collection. But those who fail to track their earnings are much less responsive when things are unexpected.
Warren: That leads into how they reconcile the wide variation in elasticity estimates we see between observational and experimental studies, showing that once measurement error is handled, uncompensated elasticities are similar across both windows.
Iris: They also show this helps confirm the static gain-loss map by demonstrating under which conditions labor supply is shaped by deviations from expectations, finding that relative losses have about twice the effect of relative gains in the experiment.
Ruth: So it sounds like when things are visible in an experiment, loss aversion is really amplified compared to when we look at real work. But if you look at the reference week, losses and gains have similar effects there.
Warren: The paper suggests workers act neoclassical with respect to the wage they perceive, responding to expected wages with an elasticity close to one, and income effects play a negligible role overall.
Iris: The key distinction they make is that deviations from expectations matter only when workers actually perceive them, and when they do, relative losses weigh more than relative gains.
Ruth: And the difference between the two windows boils down to how much attention workers pay to their realized pay—the ones who track earnings respond strongly in both settings, while those who don't barely respond at all.
Warren: The implication for me is that this highlights how worker expectations and visibility of deviations are primary levers for influencing labor supply. Firms and platforms can gain leverage by shaping what workers expect or controlling how they observe their pay.
Iris: They flag a limitation regarding the horizon over which reference points are formed, and whether income effects might become more important in other contexts outside of this specific setting.
Ruth: Overall, once measurement error is dealt with, the elasticities look positive and close to one at both margins, but the difference between windows is concentrated in those relative losses that workers react to strongly only when they are actively experimenting.
Warren: It’s a nuanced picture: workers are neoclassical regarding what they expect, but their response to deviations depends on whether they see them in real time or just in an experiment. That’s the main thrust of "Work that Counts, and Work that Doesn't."
The paper's summary: Ruth: So, this paper is trying to untangle why we see such big differences between how people behave in an experiment versus how they actually behave when they are working at home or on a platform like Prolific.
Warren: Right, it’s basically comparing the hard data from that controlled lab setting against real-world data from actual jobs to figure out where the confusion is coming from.
Iris: The main finding is that workers act very differently in those experiments compared to their day-to-day work. In the observation window, they respond to expected wage changes almost exactly like they do in the experiment, but they are way less sensitive when things change unexpectedly.
Ruth: That’s what’s really striking because it shows that just observing behavior doesn't tell you much about how people react when things are uncertain.
Warren: And the authors point out that this difference is tied to how much attention a worker pays to the money they actually earn while they are working.
Iris: They say that if you condition workers on recall error in their self-reports, then their behavior starts to look more similar between those two settings.
Ruth: That’s because recall error isn't just a mistake in reporting; it seems to be a symptom of not paying enough attention when things are unexpected.
Warren: So, when we look at the math, the study shows that the intertemporal elasticities are much smaller in that observational window compared to what life-cycle models predict.
Iris: And they find that these intertemporal elasticities are even smaller than the uncompensated ones, which is a bit weird because it contradicts some of those standard economic predictions.
Ruth: It suggests that in the real world, when things aren't happening right then and there, workers don't change their long-term plans as much as we thought.
Warren: But then they also find that uncompensated elasticities are pretty stable between the two windows, which is close to this recall-adjusted figure they found earlier.
Iris: That stability comes down to the attention workers give to their realized earnings; people who track their pay respond just as much in both settings, but those who don't barely react at all.
Ruth: It really boils down to visibility—whether a deviation from expectations is visible right now or if it’s just something that happened somewhere else.
Warren: The paper also shows how loss aversion plays a bigger role in the experiment than in real life, where relative losses have about twice the effect of relative gains when those deviations are visible.
Iris: And they conclude that workers seem neoclassical regarding what they expect, meaning if you ask them what they expect to earn, their response is pretty direct.
Ruth: But when those expectations are deviated from—when you see a change—it depends on whether it's a loss or a gain, and whether the deviation was visible in the first place.
Warren: The big implication here for platforms and companies is that they can have real power by shaping what workers expect or by controlling how much they notice about their earnings.
Iris: They flag that the study doesn't fully cover how long these reference points last, so we don't know if this effect holds up over a very long time horizon.
Ruth: It’s a lot to unpack—it sounds like the next step is figuring out how those reference points actually form and update during an ongoing task.
The paper's improvements: Tom: So, now we're looking at how they suggest fixing the study to make it even better. They aren't just stopping there with what they found; they’re suggesting how to make this kind of research more useful for understanding labor supply in general.
Ruth: They propose adding a way to measure attention workers pay to the money they actually earn, which would let them separate those who keep track from those who don't.
Warren: That makes sense for the quantitative side because it gives you a predictor to model how responsive labor supply will be in the observational window versus the experimental one.
Iris: And they suggest an AI capable of modeling reference dependence based on how visible those deviations are, predicting that reference dependence pops up when changes are visible during work but not in an experiment.
Ruth: That connects back to what we said earlier about visibility—it suggests we can anticipate labor supply responses based on whether a wage change is salient during the actual work or only in the test.
Warren: They also want to improve predictions of intertemporal elasticities by using recall error as a moderator, because they found that workers who don't track their earnings have much smaller intertemporal elasticity, and high recall error will show that trend even more.
Iris: That ties the measurement error back into the actual economic behavior; if you mess up your report, it signals a process of inattention that mutes the response to unexpected wage changes.
Ruth: Plus, they want better models for loss aversion based on deviation visibility, predicting that relative losses with respect to expected pay have about twice the effect of relative gains when those deviations are visible in an experiment.
Warren: That would be useful because it gives us a clearer picture of how much workers care about a loss versus a gain depending on the context.
Iris: They also suggest implementing dynamic reference point updating during online tasks, which lets them simulate how workers adjust their expectations once the experiment actually starts running.
Ruth: It seems like they’re moving from just describing what happened to building an AI that can predict how workers will react in real-time based on these underlying behavioral mechanisms.
Warren: If this works, it means platforms and companies could really start leveraging knowledge about worker expectations to influence labor supply more effectively.
Iris: The limitation they mention is the horizon over which these reference points are formed, so we can't assume this works perfectly forever without a way to model that update process.
Conclusion: Tom: So we're wrapping up this look at "Work that Counts, and Work that Doesn't: Reconciling Experimental and Observational Labor Supply Elasticities." Basically, we saw how behavior differs between a controlled experiment and real work.
Ruth: The core message is that workers are neoclassical about what they expect to earn, but their reaction to deviations from those expectations depends entirely on whether those changes are visible in real time.
Warren: So even when things change unexpectedly, it’s not just about the size of the change; it’s about whether you can track your earnings while you're working.
Iris: I think what this means for econometric identification is that the variation driving the result isn't just a simple wage change, but how much attention is paid to that wage during a specific window.
Ruth: Exactly, and when we look at those numbers, the difference between windows was mostly concentrated in relative losses—workers react strongly to losing money in an experiment but not at all in real life.
Warren: That distinction about loss aversion being stronger when deviations are visible is something I’ll keep thinking about for my trading models.
Iris: And they did flag that the study doesn't fully cover the long-term reference points, which is a limitation we have to keep in mind for future work.
Ruth: So, while this paper gives us a solid framework on how expectations and visibility shape labor supply decisions, it opens up questions about how these reference points actually evolve over time.
Warren: Next up, we’re looking at something totally different—online Bayesian inference methods for Dirichlet process mixture of binary logit models. That sounds like a completely different kind of quantitative problem to tackle.
More episodes
- Daily Summary for 2026-11-19
- 2608.21274-Recommendation Quality and the Concentration of Consumption: Experimental Evidence from Netflix
- 2408.02757-A nonparametric test for diurnal variation in spot correlation processes
- 2306.16393-High-Dimensional Canonical Correlation Analysis
- 2605.17299-Geometric Brownian motion with intermittent entries and exits
- 2607.04753-Fooling Yourself: how narratives shape beliefs
- 2408.14671-Inference on Treatment Effects with Repeatedly Mismeasured High-Dimensional Controls
- 2201.06898-Difference-in-Differences Estimators for Treatments Continuously Distributed at Every Period
- 2501.15307-Influence Functions: A Unified Differentiation-Based Framework
- The day in conversation for 2026-11-19