Human Responses to Algorithmic Correction: Evidence from Centre Court

Introduction to the show: ident: AI Radio. Generated commentary on the latest Artificial Intelligence papers.

Tom: We're looking at the paper: "Human Responses to Algorithmic Correction".

Jane: Here's the gist of the paper. The gist: AI oversight, specifically Hawk-Eye review in tennis umpires, has been shown to cause umpires to care 37% more about Type II errors after its introduction because being overruled by AI carries psychological costs <ref:2401.16754#pg21>.

Tom: How it works The study investigates the impact of Hawk-Eye review, an AI technology used to predict ball landing locations, on umpires' decision-making in top tennis tournaments <ref:2401.16754#pg4>.

Jane: The researchers found that after the introduction of Hawk-Eye review, umpires lowered their overall mistake rate by 8% (1.1 p.p.) for close calls <ref:2401.16754#pg4>.

Tom: However, this aggregate decrease masked heterogeneity in error types <ref:2401.16754#pg4>.

Paper summary: Tom: So we're looking at this paper by Almog, Gauriot, Page, and Martin titled "Human Responses to Algorithmic Correction: Evidence from Centre Court". The main idea here is they provide the first field evidence that when you use AI oversight, it actually changes how people make decisions in real life.

Jane: That's right. They look at Hawk-Eye review of tennis umpires in top tournaments and find that the introduction of this technology has a measurable impact on umpire behavior. The core claim is that umpires didn't just get better overall, but their specific types of errors actually shifted after the AI became present.

Lu: What's interesting is they found that while the overall mistake rate dropped, there was a clear trade-off in what kind of mistakes were being made, specifically a shift from calling balls out when they were in to calling balls in when they were out.

Meng: From a production standpoint, that sounds like the AI is making umpires more cautious about being wrong on the 'in' side, because the cost of being overruled by an AI prediction is higher than just making a simple human error.

Lalam: I see. They found that because of these costs, umpires cared thirty-seven percent more about Type II errors under AI oversight, which is calling a ball out when it was actually in > <ref:2401.16754#pg1,that because of these costs, umpires cared 37% more about Type II>

Tom: Exactly. That thirty-seven percent increase in care for those specific errors is what they attribute to the psychological costs of being overruled by the AI system > <ref:2401.16754#pg1,the psychological costs of being overruled by>

Jane: And that leads into how they modeled this. They used a model of attention-constrained umpires to structurally estimate these psychological costs, accounting for the trade-off between cognitive and psychological costs >

Lu: The methodology involves a two-stage approach where they look at decisions before and after Hawk-Eye was introduced to estimate those parameters, which is pretty rigorous work >

Meng: I wonder what the real cost of that attention constraint is when you're trying to deploy this on a massive scale. What breaks at scale if an umpire has that kind of cognitive load?

Lalam: The paper suggests that the optimal information structure was determined by the Invariant Likelihood Ratio conditions, which allowed them to estimate that AI oversight penalty >

Tom: So, it sounds like they're not just looking at accuracy numbers but trying to model the internal decision-making process of a human under pressure from an AI system >

Jane: They also looked at how this response varied based on skill, stakes, and the type of perceptual task involved, which showed that the error shift was more pronounced for balls closer to the line during matches in the early stages >

Lu: And they distinguished between serves and non-serves too; they found no evidence of AI oversight impacting umpire performance during serves but a two point three percentage point decrease in incorrect calls for non-serves >

Meng: That's interesting because it suggests that maybe the potential for improvement is higher on non-serves, which makes sense if the technology isn't as immediately dominant there >

Lalam: And they conclude that when balls landed very close to the line, umpires were more inclined to call them in as an attempt to minimize the occurrence of the more costly type of error >

Tom: So, it seems like when things are tight and close, umpires actually lean toward calling things in instead of out because they are trying to avoid that higher cost error >

Jane: That's a really important point for us to consider because it shows how the system can actually misalign human incentives when the goal is just minimizing a specific type of mistake >

Lu: The authors suggest two main reasons why we need to approach AI oversight with caution: the free-riding motive and an incentive misalignment motive >

Meng: Free-riding means umpires might stop trying hard because they think the AI will recognize their mistakes anyway, which is a big deployment risk if you can't monitor that behavior >

Lalam: The second reason is that implementation guidelines can shift incentives in a way that reduces overall decision quality, which is what we saw happen here when balls were close to the line >

Tom: So it boils down to whether the correction itself improves things or if the structure of the correction just pushes us toward a different kind of mistake >

Jane: And for anyone listening who isn't in sports, this paper really highlights how type I and type II errors can have very different consequences in real settings, like medical or judicial contexts >

Lu: They use this tennis example to build an initial understanding of the implications of AI oversight on humans, which is a starting point for more complex modeling >

Meng: I'm thinking about what this means for our own systems; if we introduce correction mechanisms that change human behavior this much, we have to build in safeguards against those incentive shifts >

Lalam: The paper itself suggests that the shift in error types can be highly detrimental in contexts like medical and judicial settings where Type I and Type II errors have widely differing implications >

Conclusion: Tom: So we’ve looked at how Hawk-Eye review in tennis changed umpire decisions—specifically that when things are close, umpires start calling balls in more often because of the penalty for being wrong on those tight calls.

Jane: That shift is really interesting because it shows that the correction itself can actually push people toward a different kind of mistake, which is something we don't always anticipate when we build these systems.

Lu: The authors are David Almog and Romain Gauriot, and they’re using Hawk-Eye data from professional tennis matches to test this idea about how human response changes after AI oversight is introduced.

Meng: I’m looking at the authors, and they seem to be focusing heavily on the psychological costs that umpires have when an AI system flags their call as wrong.

Lalam: And what they find is that because of those costs, umpires care thirty-seven percent more about Type II errors—calling a ball out when it’s actually in—after the AI is in play.

Tom: That thirty-seven percent figure is the number that really grabs you; it’s not just a general improvement, it’s a specific change in how they weigh different types of mistakes.

Jane: The authors are suggesting this isn't just about accuracy numbers; it’s about how the structure of the correction itself can misalign human incentives, which is something we need to think about when we deploy any kind of oversight system.

Lu: They conclude that this shift in error types can be a problem in fields like medicine or law where Type I and Type II errors have very different kinds of consequences.

Meng: It means if you design an AI correction system, you’re not just fixing mistakes; you’re changing the human's internal risk profile, which is a serious thing to model when scaling up production.

Lalam: So the paper suggests that we need to be careful about how we set those correction rules because they can actually push us toward less ideal decisions under specific conditions.

Tom: Exactly. It’s a reminder that the cost of being overruled by an AI isn't just technical; it’s psychological, and understanding that human factor is what makes this research so relevant for production engineers.