Generative AI at Work
summary
The gist
As a diligent researcher, I have thoroughly analyzed both provided texts (A and B) concerning the paper "Generative AI at Work." The goal is to synthesize these findings into a comprehensive…
In short
The study tested how using a generative AI assistant in customer support changed agent productivity and skills. Findings show overall productivity increased by 15%, especially for novice agents who learned quickly from AI recommendations. The tool also improved customer sentiment and reduced supervisor escalations, though long-term effects on labor demand remain uncertain.
Key concepts
- Productivity Gain Heterogeneity
- AI boosted worker productivity by 15% overall, but this benefit varied greatly. Novice agents saw the biggest gains (30% increase in issue resolution per hour), while experienced agents saw minimal change or slight quality dips. This suggests AI helps beginners learn faster by following AI guidance.
- Durable Worker Learning
- The productivity boost stems from 'durable worker learning,' where agents actively engage with and follow the recommendations provided by the AI. This process allows workers to adopt best practices from more skilled colleagues, helping lower-skilled agents converge toward higher proficiency levels over time.
- Customer Sentiment Improvement
- Agents using AI assistance experienced better work experiences because customers reacted positively. The presence of the AI reduced customer questions about agent competence, leading to fewer escalations to supervisors and a decrease in worker attrition.
Terminology used across episodes
This episode discusses
- Generative AI at Work · Paper Radio
- Language Models are Few-Shot Learners
- Sparks of Artificial General Intelligence: Early experiments with GPT-4
- GPTs are GPTs: An Early Look at the Labor Market Impact Potential of Large Language Models
- Scaling Laws for Neural Language Models
- Summary of ChatGPT-Related Research and Perspective Towards the Future of Large Language Models
- Training language models to follow instructions with human feedback
- ICT Capital-Skill Complementarity and Wage Inequality: Evidence from OECD Countries
- Attention Is All You Need
The paper
Generative AI at Work · Read on arXiv
Erik Brynjolfsson, Danielle Li, Lindsey Raymond
Stanford University · MIT
We study the staggered introduction of a generative AI-based conversational assistant using data from 5,172 customer support agents. Access to AI assistance increases worker productivity, as measured by issues resolved per hour, by 15% on average, with substantial heterogeneity across workers. Less experienced and lower-skilled workers improve both the speed and quality of their output while the most experienced and highest-skilled workers see small gains in speed and small declines in quality. We also find evidence that AI assistance facilitates worker learning and improves English fluency, particularly among international agents. While AI systems improve with more training data, we find that the gains from AI adoption are largest for relatively rare problems, where human agents have less baseline training and experience. Finally, we provide evidence that AI assistance improves the experience of work along two key dimensions: customers are more polite and less likely to ask to speak to a manager.
Transcript
Introduction to the show: ident: Economics. The day in economics: theory, mechanisms and the evidence beneath them.
Ruth: We're looking at the paper: "Generative AI at Work".
Warren: Here's the gist of the paper. As a diligent researcher, I have thoroughly analyzed both provided texts (A and B) concerning the paper "Generative AI at Work." The goal is to synthesize these findings into a comprehensive, detailed summary that maintains high fidelity to the original content while ensuring structural coherence.
Ruth: Here is the combined, detailed research summary: Comprehensive Research Summary of "Generative AI at Work" This paper provides empirical evidence on the economic and behavioral impacts of deploying a generative AI-based conversational assistant within a real-world customer support environment.
Warren: The study utilizes data from 5,172 customer support agents to examine how access to this AI tool affects worker productivity, language skills, the experience of work, and customer interactions.
Ruth: Key Findings on Productivity and Skill Heterogeneity: The central finding is that access to generative AI assistance increases overall worker productivity by 15%, measured specifically by the number of customer issues resolved per hour.
Paper summary: Ruth: Now that we know it boosts productivity by fifteen percent overall, the paper also looked into the experience of work and customer interactions.
Warren: Right, they found two main ways that AI assistance improves how agents feel about their job.
Iris: One is customer sentiment; customers are more polite when they talk to an agent who has access to this AI tool.
Ruth: That’s a big deal because it means fewer customers are likely to ask to speak with a manager, which leads directly into the next point.
Warren: What’s that second thing? What does it do for the agent experience?
Iris: The second thing is managerial escalation; customers are less likely to question if an agent is competent and request a supervisor.
Ruth: So, in short, AI assistance improves customer sentiment and reduces the need for managers to step in, which helps with worker retention among newer staff.
Warren: It sounds like the authors are pointing toward a positive shift in how we see the interaction between agents and customers.
Iris: And they also look at what this means for the long term, though they have to be careful about their scope.
Ruth: That’s right; it’s important to remember these findings are only medium-run impacts within a single firm, not some sweeping statement about the whole job market.
Warren: And the authors do raise some pretty important questions about long-term incentives for workers and labor demand.
Iris: They wonder if top performers might stop trying to create new solutions because they follow the AI recommendations too closely.
Ruth: That prompts a discussion on how compensation policies need to change so that workers are incentivized to contribute those successful behaviors for training the models.
Conclusion: Warren: So, looking at this paper, "Generative AI at Work," the authors are making a case that deploying conversational AI in support roles actually creates measurable productivity gains, particularly for less experienced workers.
Ruth: They're showing that this boost isn't uniform and is tied to learning—how agents interact with the tool shapes their skills over time.
Iris: The paper also highlights how this technology can positively affect the customer experience by making customers more polite and reducing escalation to supervisors.
Warren: But they also point out a big caveat about generalizing these results; they stress that these findings are context-specific to one AI tool, one occupation, and one firm.
Ruth: And the authors are asking some forward-looking questions about what happens if customer demand for assistance isn't inelastic—if we get more productive agents, does that mean fewer human hours are needed overall?
Iris: It’s a conversation about how this technology might shift labor demand and create new roles in testing and training these AI models.
Warren: So the main thing is this paper shows that generative AI at work isn't just about automating tasks; it’s about changing the skill dynamics within a team and the nature of customer service interactions.
More episodes
- Daily Summary for 2026-11-19
- 2608.21274-Recommendation Quality and the Concentration of Consumption: Experimental Evidence from Netflix
- 2408.02757-A nonparametric test for diurnal variation in spot correlation processes
- 2306.16393-High-Dimensional Canonical Correlation Analysis
- 2605.17299-Geometric Brownian motion with intermittent entries and exits
- 2607.04753-Fooling Yourself: how narratives shape beliefs
- 2408.14671-Inference on Treatment Effects with Repeatedly Mismeasured High-Dimensional Controls
- 2201.06898-Difference-in-Differences Estimators for Treatments Continuously Distributed at Every Period
- 2501.15307-Influence Functions: A Unified Differentiation-Based Framework
- The day in conversation for 2026-11-19