Separating the Wheat from the Chaff
summary
The gist
Separating the Wheat from the Chaff studies a reputational cheap-talk environment in which a judge must choose between an expert and a quack to identify the expert…
In short
The study models a cheap-talk environment where a judge must distinguish an expert from a quack. It shows that in equilibrium, the expert always tells the truth, and the quack mimics him. Competition disciplines communication by rewarding extreme messages when choices are tied, leading to truthful reporting while potentially amplifying existing informational differences.
Key concepts
- Reputational Cheap-Talk Game
- A three-player game where a judge chooses between an expert (who knows the truth) and a quack (who doesn't). Both speakers want to be chosen, but the judge wants to identify the expert. The core finding is that this competition leads to predictable behaviors in communication.
- Information Begets Information
- This means that judges with more precise private knowledge about a situation are better at identifying the expert and learning the true state. Exposure to different sources of uncertain reliability can actually make informational inequality between audiences grow, even if it doesn't rely on bias.
- Ex-Ante Symmetry
- In this context, ex-ante symmetry refers to whether a speaker's strategy is identical regardless of what the other speaker does beforehand. The paper shows that sequential communication (speakers reporting one after another) breaks this symmetry for the quack relative to the expert.
Terminology used across episodes
This episode discusses
The paper
Separating the Wheat from the Chaff · Read on arXiv
Toulouse School of Economics · London School of Economics
We study a reputational cheap-talk environment in which a judge chooses between two speakers of unknown expertise, an expert and a quack. Both speakers seek to be selected, while the judge wishes to identify the expert. The best equilibrium for the judge features truth-telling by the expert, yet the judge favors speakers with more extreme messages. This bias toward extremism does not induce exaggeration, but instead sustains truthful communication. We characterize the quack's equilibrium messaging strategy, relating the degree to which it panders to the judge's prior to the state distribution, the speakers' initial reputations, and the judge's private knowledge of the state. We interpret these results in the context of two applications, the post-training of AI chatbots through human feedback and media competition.
Transcript
Introduction to the show: ident: Economics. The day in economics: theory, mechanisms and the evidence beneath them.
Ruth: We're looking at the paper: "Separating the Wheat from the Chaff".
Warren: Here's the gist of the paper. Separating the Wheat from the Chaff studies a reputational cheap-talk environment in which a judge must choose between an expert and a quack to identify the expert, showing that truth-telling by the expert is robust and that learning in this setting exhibits an “information begets information” property The Core Game Structure The study introduces a three-player reputational cheap-talk game where a judge selects one of two speakers, one of whom is an expert perfectly informed about the state and the other is a quack with no information The speakers simultaneously send messages, and the judge selects one, with both seeking to be chosen while the judge wishes to identify the expert In this setting, an equilibrium exists where the expert reports truthfully and the quack strategically mimics the expert’s speech The judge's objective is to select the correct speaker, and each speaker wishes to be selected.
Ruth: Equilibrium Features The paper characterizes an equilibrium in which the expert always messages the true state ω and the quack’s messaging strategy replicates the prior state distribution, U
-1, 1: This equilibrium is supported by different selection strategies φ that reward speakers who send extreme messages.
Warren: A key feature is that when indifferent between two consistent messages, the judge must favor the consistent speaker who sends a more extreme message This premium given to extremism does not induce exaggeration by the expert, but instead sustains truthful communication.
Ruth: Information Amplification A central feature of equilibrium is that information begets information, meaning judges with more precise private knowledge are more likely to identify the expert and learn the true state This mechanism implies that exposure to competing sources of uncertain reliability may amplify informational inequality across audiences This observation offers a simple explanation for the coexistence of widespread access to information and growing informational inequality, without appealing to partisan bias or selective exposure.
Paper summary: Warren: So thinking about the whole paper, "Separating the Wheat from the Chaff," what does it actually mean for us outside of this game structure? Ruth I think it means that in environments where people have varying levels of information and are trying to figure out who to trust, competition itself can be a mechanism that forces some level of honesty.
Iris: It’s about how the setup—the judge choosing between an expert and a quack—creates incentives that favor truth-telling from the informed side, even when the stakes are high for both participants. Warren And it shows us that this isn't just a simple game; there are specific rules, like favoring more extreme messages when things are tied, that drive the equilibrium.
Ruth: Right, so if you look at it simply, the expert tells the truth because the structure rewards it through those tie-breaking rules. Warren And for someone just listening to this show, what's the big picture here? It’s about how reliable information can be pulled out of strategic claims through these competitive dynamics.
Iris: It points toward a way that reliable information can be extracted from messy situations, even when the sources aren't perfectly trustworthy. Ruth And it also shows that this process can have a side effect where it amplifies existing differences in what different groups believe they know about the situation.
Warren: The paper is quite robust across different assumptions about how much noise there is or how people are initially set up to believe certain things. Iris And one limitation the authors themselves mention is that this whole model relies on a specific baseline where the judge has some domain-specific heuristics, which means it doesn't capture every single nuance of real-world decision making.
Ruth: That makes sense; they're not trying to model reality perfectly, just to show what happens under these specific conditions. Warren But what they do show is that truth-telling by the expert is maintained because the structure is set up to keep it that way through those selection rules and the information feedback loop.
Iris: So ultimately, this paper gives us a framework for understanding why certain behaviors emerge in competitive information settings, showing how incentives shape communication patterns between experts and those who aren't.
Conclusion: Ruth: So we've been looking at how this game between an expert and a quack plays out, and now we’re going to wrap up what "Separating the Wheat from the Chaff" actually means for us.
Warren: It boils down to competition disciplining communication. The core idea is that in the judge's best scenario, the expert tells his true state, and that quack just copies him strategically.
Iris: And they do that because when things are tied on what both speakers say, the judge has to pick the one who makes a more extreme message. That premium for extremity sustains truth-telling from the expert.
Ruth: Right, so competition isn't just random noise; it’s actually a mechanism that forces the expert to be honest because of how the judge is set up to reward those specific types of signals.
Warren: It’s about extracting reliable information from what would otherwise be a messy exchange between someone who knows the truth and someone who doesn't.
Iris: But there’s a caveat, and it’s important. This whole structure amplifies existing differences in what different groups already think they know about the situation.
Ruth: So we have this system where reliable information can be pulled out from strategic claims, but it also has this side effect of making pre-existing knowledge gaps between audiences wider.
Warren: The authors show that this works even when you add more complexity, like different ways people start to believe things or varying noise in the judge's private signals.
Iris: They also look at how learning happens. If the judge has a clearer signal about what’s happening, they get better at figuring out the true state of things.
Ruth: It suggests that exposure to competing sources of information can actually increase informational inequality across different groups in a way that isn't just about bias.
Warren: That’s the big picture for me—it shows how we can extract reliable signals even when the sources aren't perfectly trustworthy, provided you have a judge with some level of private knowledge.
Iris: And they also look at sequential communication, which changes things entirely by disrupting the quack’s symmetry with the expert.
Ruth: It’s a tight squeeze for these speakers—the expert stays truthful, the quack mimics him in this setup—and it's a neat mechanism for extracting signal.
Warren: So what this means for us is that when you look at how information flows between experts and non-experts, the structure matters more than just the individual claims being made.
More episodes
- Daily Summary for 2026-11-19
- 2608.21274-Recommendation Quality and the Concentration of Consumption: Experimental Evidence from Netflix
- 2408.02757-A nonparametric test for diurnal variation in spot correlation processes
- 2306.16393-High-Dimensional Canonical Correlation Analysis
- 2605.17299-Geometric Brownian motion with intermittent entries and exits
- 2607.04753-Fooling Yourself: how narratives shape beliefs
- 2408.14671-Inference on Treatment Effects with Repeatedly Mismeasured High-Dimensional Controls
- 2201.06898-Difference-in-Differences Estimators for Treatments Continuously Distributed at Every Period
- 2501.15307-Influence Functions: A Unified Differentiation-Based Framework
- The day in conversation for 2026-11-19