People escalate against a competitor labelled human and hold back against one labelled an optimising machine

summary

The gist

People escalate against a competitor labelled human and hold back against one labelled an optimising machine The information effect is not explained by articulated strategy…

In short

The study investigated how people react when competing against two types of adversaries: one labeled 'human' and another labeled an 'optimising machine.' The findings suggest that people escalate their competitive actions against humans but restrain them when facing an optimising machine. This information effect is not explained by strategy or individual differences, indicating it arises from a competitive response triggered by the possibility of a human competitor.

Key concepts

Human Competitor Label
This refers to a competitor explicitly identified as being human. The research shows that when facing this type of competitor, people tend to escalate their efforts in competition against them.
Optimising Machine Label
This label is applied to a competitor perceived as an optimising machine. When facing this type of opponent, people tend to hold back their competitive actions.
Information Effect
This phenomenon describes a change in behavior driven by the information available about the competitor's nature. In this case, the effect on behavior is not due to how strategically people choose to act or inherent differences between individuals.
Competitive Response
This is the overall pattern of action taken by people in response to a perceived competitor. The paper concludes that the observed difference in behavior is a competitive response specifically engaged when a human competitor remains a live possibility.

Terminology used across episodes

This episode discusses

The paper

People escalate against a competitor labelled human and hold back against one labelled an optimising machine · Read on arXiv

Karlsruhe Institute of Technology (KIT) · Singularity AI

Transcript

Introduction to the show: ident: Computer Science. The day in computer science: software, systems and theory on arXiv.

Tom: I'm Tom.

Jane: And I'm Jane, here with Lu, Meng and our in-house large language model, Lalam.

Tom: We're looking at the paper: "People escalate against a competitor labelled human and hold back against one labelled an optimising machine".

Jane: Here's the gist of the paper. People escalate against a competitor labelled human and hold back against one labelled an optimising machine The information effect is not explained by articulated strategy, or individual differences, and is consistent with a competitive response engaged when a human is a live possibility

Paper summary: Tom: So we’ve talked through the paper "People escalate against a competitor labelled human and hold back against one labelled an optimising machine." The main thing is that the way you describe the opponent matters as much as who they actually are.

Jane: It really boils down to separating what's happening inside the system from what's happening because of the information we provide. We see this split between the opponent effect and the information effect throughout >Page two>.

Lu: The paper shows that if you change how a human plays, that’s an opponent effect, but if you just change the label alone, it’s an information effect >Page two>.

Meng: For us in production, this means our prompting or our system design choices are acting like that labeling—they're affecting the behavior of the user without necessarily changing the core algorithm.

Lalam: I think what this means for users is that if they know they’re up against a highly optimized system, their level of commitment changes in a predictable way >Page one> <ref:2609.21439#pg3>. It gives them something concrete to react to.

Tom: The authors clearly show how those two things—the system and the label—interact through the experimental design >Page three>. It’s not just one thing causing the change.

Jane: The paper suggests that organizations have a lot of control over that information environment, which is why understanding this distinction is important for decision-making >Page two>.

Lu: I think the big picture here is figuring out how these effects combine in more complex, real-world applications, rather than just testing them in a controlled auction setting >Page two>.

Conclusion: Tom: So we've looked at how labeling something as human versus an optimizing machine changes how people react to it in this paper, and now we’re going to talk about what that actually means for us, Tom and Jane.

Jane: The authors are looking at a system where people compete against two different things: one labeled human, and one labeled an optimizing machine.

Lu: It really boils down to how the label you give something affects the whole interaction, whether it's a person or an AI.

Meng: From my side, what I’m thinking is that if we label our system as purely optimizing, people might pull back more than if we just say it's human.

Lalam: I agree with Meng there. The paper suggests the reaction isn't just about the actual tech; it’s about the perception of what you’re facing.

Tom: Exactly. It's not some deep strategy thing, or even individual differences that explain this effect; it seems tied to how we frame the competitor.

Jane: So if you change the label, that changes how people engage with the system, and it’s not just a quirk of psychology.

Lu: The paper shows that this information effect is consistent with a competitive response engaged when a human is still a live possibility in the mix.

Meng: That suggests our labeling choices are part of our design, not just semantics on top of the code.

Lalam: It means if we're building something that needs to be deployed at scale, that label has real weight on how users behave and what they expect from us.

Tom: It makes you wonder how much control we actually have over these labels when you’re trying to get models running in the wild.

Jane: It really puts the focus on how we frame the interaction with our AI systems moving forward, which leads into thinking about the real-world deployment challenges.

More episodes

← Home