Choosing Complexity: Cognitive Ability, Overconfidence, and Task Choice
Listen
Radio episode about this paper
Transcript
Introduction to the show: ident: Economics. The day in economics: theory, mechanisms and the evidence beneath them.
Ruth: We're looking at the paper: "Choosing Complexity: Cognitive Ability, Overconfidence, and Task Choice".
Warren: Here's the gist of the paper. Workers and organizations routinely choose between complex tasks that differ in their success-payment tradeoff, and this paper studies how cognitive ability and overconfidence shape this choice of task complexity both theoretically and experimentally The single most informative sentence about the paper's subject and finding is that those who fail to choose optimally pick tasks that are too complex Theoretical Model Development The authors develop a model in which the probability of making a mistake in a task is determined by two factors: task complexity and the decision-maker’s cognitive ability The mistake probability depends on task complexity and cognitive ability in two intuitive ways, specifically that it increases with complexity and decreases with cognitive ability The functional form used is Pm(ai, ct) = α + β1ai + β2ct + β3aict This model directly yields the first hypothesis, which states that more cognitively able individuals choose more complex tasks Empirical Findings on Choice The experimental results strongly support the initial hypotheses regarding task selection First, higher cognitive ability predicts the choice of more complex tasks in both pairs, with an increase in normalized Raven score from 0 to 1 associated with a 36 percentage-point higher probability of choosing the more complex task on average Second, conditional on cognitive ability, more overconfident subjects choose the more complex task substantially more often, with an increase in overconfidence over this range associated with a 21 percentage-point higher probability of choosing the more complex task on average Optimality and Efficiency The analysis reveals that in about 75% of decisions, subjects choose optimally, but those who fail to choose optimally are undercautious, choosing the more complex task when the less complex task had a higher expected payoff Furthermore, there is some weak evidence that cognitive ability is associated with more efficient choices of task complexity This efficiency measure is defined as the ratio of the expected payoff from the chosen task to the expected payoff from the optimal task, equaling one when the subject chooses optimally Organizational Implications The findings suggest that organizations and managers should actively design task menus, incentives for choosing more complex tasks, and feedback structures to account for how workers choose task complexity and sometimes overreach by choosing tasks that are too complex Specifically, they should pair the choice of more complex tasks with clear information and feedback such as historical success rates for comparable tasks or post-project reviews that distinguish poor task choice from poor task execution These features can help preserve the benefits of self-selection while helping workers learn when ambition is productive Future Research Directions The paper suggests directions for future work, including strategic interaction where the complexity of tasks chosen by coworkers directly affects a worker’s own payoffs Another direction concerns dynamic settings with learning and skill accumulation to understand when feedback corrects overreach and when it instead reinforces miscalibrated confidence The authors also note that the negative association between overconfidence and binary optimality is driven by undercautious overconfident subjects who choose the more complex task when the less complex task offers a higher expected payoff The paper concludes by stating that organizations can preserve the benefits of self-selection by pairing complex-task choices with clear information and feedback The authors also note that rewards for completing more complex tasks can help attract workers who are able to perform them, but they may also encourage overambitious workers to choose tasks for which the expected payoff is lower The paper's primary contribution is extending the literature on choice of task complexity by linking cognitive ability and overconfidence jointly to selection between complex tasks that differ in their success-payment tradeoff The authors also contribute to the literature on cognitive ability and decision making in complex settings by considering the link between cognitive ability and the optimality of task choice The paper documents a sharp asymmetry where subjects who err tend to overreach by choosing tasks that are too complex The authors also find that cognitive ability predicts realized earnings in both pairs, consistent with Proposition 3 The findings establish that cognitive ability and overconfidence are independent predictors of the choice of task complexity
Title and authors: Ruth: So we’re talking about this paper today, "Choosing Complexity: Cognitive Ability, Overconfidence, and Task Choice." It looks at how people decide which task to take on when those tasks have different payoffs based on how hard they are.
Warren: Yeah, it's about that trade-off between success and payment. The core idea is looking at cognitive ability and overconfidence as the two main things that shape this choice of task complexity. It sets up a model to see if those two factors actually matter in how people make these decisions on their own.
Iris: What makes it interesting for us is that it tries to link those behavioral elements—ability and confidence—directly into the probability of making a mistake, which is what drives the whole choice process. It suggests that complexity doesn't just increase risk; how you handle that risk depends on your skill level too.
Ruth: Exactly. The paper sets up this mathematical model where the probability of making a mistake in a task is determined by both how complex the task is and how cognitively able the person making the choice is. They use this to test if more able people pick harder tasks, and whether overconfident people do too.
Warren: That's interesting because it tests two distinct behavioral assumptions. First, they assume that a person’s belief about their own cognitive ability shapes what task they pick, which leads to the first hypothesis: more cognitively able individuals choose more complex tasks. Then they add another layer by assuming that a person’s level of overconfidence influences their choice, leading to the second hypothesis about overconfident people choosing more complex tasks.
Iris: So the model shows that there's a direct link between ability and complexity selection, and then an independent link between overconfidence and complexity selection after controlling for ability. That’s a pretty clear separation in how these two factors influence task choice.
Ruth: And the experimental results seem to back that up quite strongly. They found that higher cognitive ability predicts the choice of more complex tasks in both pairs, with an increase in normalized Raven score from zero to one associated with a thirty-six percentage-point higher probability of choosing the more complex task on average.
Title and authors: Warren: That's a significant jump for the ability factor, showing that being cognitively able makes you much more likely to opt for the harder work. And it’s not just about ability; they also found that conditional on cognitive ability, more overconfident subjects choose the more complex task substantially more often, with an increase in overconfidence over this range associated with a twenty-one percentage-point higher probability of choosing the more complex task on average.
Iris: So it seems like both factors—ability and confidence—push people toward complexity. But the real surprise, according to the paper, is what happens when people mess up. It finds that in about seventy-five percent of decisions, subjects pick their payoff-maximizing task correctly, but those who fail to choose optimally are undercautious.
Ruth: That’s a key finding. Those who aren't choosing optimally tend to be undercautious, meaning they’re picking the more complex task even when the simpler task would have given them a higher expected payoff. They are overreaching in their choices rather than just being bad at execution.
Warren: And there’s also this weak evidence that cognitive ability is associated with more efficient choices of task complexity. Efficiency, they define it as the ratio of the expected payoff from the chosen task to the expected payoff from the optimal task, which equals one when you choose optimally. So, being able to pick correctly might actually help you be more efficient in your selection.
Iris: That efficiency measure is important because it tells us if ability translates into smarter choices or just better execution after the choice is made. It’s a nuance beyond just predicting whether someone picks a hard task or not at all.
Ruth: The authors suggest some real-world ways to use these findings. They argue that organizations and managers should design task menus and incentives for choosing more complex tasks, but they have to pair that with information and feedback so workers can assess their ability and probability of success.
Warren: That makes sense, but it’s not just about giving them a harder task; it’s about giving them the right context. The paper suggests using historical success rates for comparable tasks or post-project reviews that clearly separate poor task choice from poor task execution.
Iris: So the goal is to preserve the benefits of self-selection—letting workers choose what they think is best for them—but making sure that ambition doesn't turn into costly overreach. That’s a practical application of linking cognitive ability and overconfidence to selection between complex tasks, as outlined in "Choosing Complexity: Cognitive Ability, Overconfidence, and Task Choice".
Title and authors: Ruth: Exactly. And they also point out some areas for future work. They mention strategic interaction where the complexity of tasks chosen by coworkers directly affects a worker’s own payoffs in a team setting.
Warren: That brings up another thing: dynamic settings with learning and skill accumulation. They want to see if we can understand when feedback actually corrects that overreach, versus when it just reinforces miscalibrated confidence. That’s where the real complexity of human decision-making comes in, beyond just the initial choice.
Iris: I also noticed they point out that the negative association between overconfidence and binary optimality is specifically driven by those undercautious overconfident subjects who choose the more complex task when the simpler task offers a higher expected payoff. It clarifies that it’s not just about being overly sure of oneself, but about miscalibrated confidence leading to poor choices.
Ruth: And they suggest that rewards for completing more complex tasks can attract workers who are able to perform them, but they also warn that those same rewards might encourage overambitious workers to choose tasks for which the expected payoff is lower. It’s a balancing act for any manager trying to structure incentives.
Warren: So the authors conclude by emphasizing that organizations can keep those benefits of self-selection by pairing complex task choices with clear information and feedback, rather than just relying on a single reward structure. The paper's primary contribution is linking cognitive ability and overconfidence jointly to selection between complex tasks that differ in their success-payment tradeoff.
Iris: I think the most important thing for the listener to take away is that when you design a system for choosing tasks, you can’t just look at complexity; you have to account for both the worker's inherent ability and their tendency toward overconfidence.
Ruth: Absolutely. So we’ve looked at how cognitive ability and overconfidence shape task choice in "Choosing Complexity: Cognitive Ability, Overconfidence, and Task Choice," and the message is clear: understanding those factors helps design better systems for work, whether it’s in a factory or a boardroom.
Warren: It sets up this framework where we can predict not just what people will pick, but why they might make a mistake by overreaching when they should have picked something simpler.
Iris: And looking ahead, the direction is to build systems that actively try to correct those errors before they become costly failures. That’s where the next set of research will probably focus.
The paper's summary: Ruth: So, to wrap up this part, we’re looking at how cognitive ability and overconfidence jointly shape the choice between tasks that have different success payoffs in this paper.
Warren: Right, it boils down to these two factors—ability and confidence—determining what kind of task a person selects based on its complexity.
Iris: The authors build this model to show that the probability of making a mistake depends on both how complex the task is and how cognitively able the decision-maker is. It’s an interaction between those two things.
Ruth: And they test that model against real data, and they find some pretty strong support for their core idea—that more able people tend to pick harder tasks, and overconfident people also pick harder tasks when you hold ability constant.
Warren: That’s a significant finding because it means we can start to predict task selection not just by the task itself, but by the worker's underlying skill and their confidence level.
Iris: But then they look at where things go wrong, and that’s where it gets interesting—they find that even if you pick correctly most of the time, those who fail to choose optimally are actually undercautious.
Ruth: Undercautious means they’re picking a task that is too complex when a simpler option would have given them a better expected return. It’s not just about being bad at doing the work; it's about making a poor initial selection.
Warren: And there’s also this idea of efficiency, which they define as the ratio of the expected payoff from your chosen task to the expected payoff from the best possible task, and when that ratio isn't one, it means you’re not choosing optimally.
Iris: They find some weak evidence that cognitive ability actually helps people make more efficient choices regarding how complex a task they select. It suggests ability isn't just about picking the right task, but picking it smartly for the payoff you get.
Ruth: The big implication here is for organizations—they shouldn’t just hand workers a list of tasks; they need to design those menus with feedback and information so people understand their own abilities and when ambition becomes unproductive.
Warren: Exactly, it points toward designing systems that help manage that overreach, instead of just rewarding the highest complexity chosen.
Iris: It also suggests we need better ways to gauge decision quality, using metrics like overconfidence to see when a worker is likely to be pushing too hard on a task selection.
Ruth: So while the model gives us the structure for *why* people choose tasks this way, it doesn't tell us exactly how to implement those organizational changes yet.
Warren: That’s right, it sets up the framework for understanding task selection, but the next step is figuring out how to build a system that actually uses this information to guide behavior in real time.
The paper's improvements: Tom: So, now we’re looking at how the authors suggest we fix these problems they identified in their initial model of task choice. It's about taking what they found and turning it into something practical for real life.
Ruth: They argue that organizations need to design task menus with real information and feedback so workers can gauge their own ability and how likely they are to succeed before they commit.
Warren: That’s a direct response to the overreach issue we talked about; instead of just giving them a harder choice, you pair it with context so they know if that complexity is actually worth the effort.
Iris: They suggest using historical success rates for similar tasks or having post-project reviews that clearly separate bad task selection from just bad task execution. That’s how you build in a safety net.
Ruth: It’s about preserving that self-selection benefit while making sure ambition doesn't lead to costly mistakes, which is what they call undercautious overreach.
Warren: They also suggest using AI systems to predict the optimal task complexity based on a worker's cognitive ability, because their model showed that more able people tend to choose more complex tasks.
Iris: That means you could personalize task assignments so they align with an individual's skill level, which should improve efficiency in the process of choosing.
Ruth: And they want to incorporate overconfidence metrics into these systems; since the paper showed that more overconfident individuals also choose more complex tasks when ability is already high, you can use that as a warning signal for potential miscalibration.
Warren: So, if an AI system flags a worker as highly overconfident, it tells you they are likely to be undercautious and might be choosing the wrong task complexity.
Iris: They also point toward low-stakes trial assignments before full responsibility, which helps workers learn when ambition is actually productive versus when overconfidence pushes them too far.
Ruth: It’s a layered approach, isn't it? You get the right task choice based on ability, you get a confidence check based on overconfidence, and you get learning opportunities to correct any errors.
Warren: So the implication is that we need systems that are dynamic; they can learn and adjust as workers accumulate skill and feedback corrects their initial miscalibrated confidence.
Iris: The authors flag one limitation, though, which is what they don't cover here: the complexity of those strategic interactions where coworkers actually influence each other’s task choices.
Ruth: That sounds like the next big research frontier—how does one worker’s choice affect another worker’s payoff?
Conclusion: Tom: So we’re wrapping up this look at "Choosing Complexity: Cognitive Ability, Overconfidence, and Task Choice." We’ve seen how ability and confidence influence which task people select based on its payoff trade-off.
Ruth: Right, essentially the paper models how those two internal factors interact to determine if someone picks a task that's too hard or too easy for them. It’s about understanding the real incentive structure behind what people actually do in a work setting.
Warren: And what it changes for us as traders or managers is realizing that blindly rewarding high complexity might just be rewarding undercautious overreach, which is inefficient.
Iris: I think the identification here is strong because they clearly separate the effect of ability from the effect of overconfidence, which is a nice econometric clean-up to make sure we’re measuring what actually matters.
Ruth: It’s about designing systems that account for that miscalibration, not just maximizing a single metric like success or speed.
Warren: And they point out that the next step involves looking at how these choices interact when multiple people are making decisions at the same time, which is where things get really interesting in a team setting.
Iris: That's a fair point; the current work focuses heavily on an individual decision process, and seeing how those choices feed into each other will be crucial for future identification.
Ruth: We’ll take that dynamic interaction—the strategic choice between coworkers—and explore that next, because understanding team dynamics is where the real complexity lives.
Warren: Definitely; we need to see if the benefits of self-selection hold up when everyone is trying to optimize their own choice against what their peers are doing.
David Gill, Zhongheng Qiao
Purdue University
econ.TH, cs.GT, econ.GN, q-fin.EC
Submitted: 2026-11-09
Updated: 2026-11-09
Comments: 71 pages, including appendices. JEL: C91, D03, D83, D91, J24
License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
Importance score: 92/100
The gist: Workers and organizations routinely choose between complex tasks that differ in their success-payment tradeoff…
Key concepts
- Task Complexity
- This refers to the difficulty level of a task, which is varied in terms of how hard it is and how much reward it offers. Workers must decide whether to tackle a simple task or a more challenging one based on the potential payoff.
- Cognitive Ability
- This measures an individual's mental capacity to process information and make decisions. The model shows that more cognitively able individuals tend to select tasks that are more complex, suggesting a link between skill and ambition.
- Overconfidence
- This describes a tendency for individuals to overestimate their own abilities or the likelihood of success. The findings indicate that when combined with cognitive ability, overconfidence significantly increases the probability of choosing overly complex tasks.
- Optimality
- This refers to making the best possible choice between two options based on expected outcomes. The analysis shows that about 75% of decisions are optimal, but those who fail often choose tasks that are too difficult for them.
Summary
Workers and organizations routinely choose between complex tasks that differ in their success-payment tradeoff, and this paper studies how cognitive ability and overconfidence shape this choice of task complexity both theoretically and experimentally The single most informative sentence about the paper's subject and finding is that those who fail to choose optimally pick tasks that are too complex
Theoretical Model Development
The authors develop a model in which the probability of making a mistake in a task is determined by two factors: task complexity and the decision-maker’s cognitive ability The mistake probability depends on task complexity and cognitive ability in two intuitive ways, specifically that it increases with complexity and decreases with cognitive ability The functional form used is Pm(ai, ct) = α + β1ai + β2ct + β3aict This model directly yields the first hypothesis, which states that more cognitively able individuals choose more complex tasks
Empirical Findings on Choice
The experimental results strongly support the initial hypotheses regarding task selection First, higher cognitive ability predicts the choice of more complex tasks in both pairs, with an increase in normalized Raven score from 0 to 1 associated with a 36 percentage-point higher probability of choosing the more complex task on average Second, conditional on cognitive ability, more overconfident subjects choose the more complex task substantially more often, with an increase in overconfidence over this range associated with a 21 percentage-point higher probability of choosing the more complex task on average
Optimality and Efficiency
The analysis reveals that in about 75% of decisions, subjects choose optimally, but those who fail to choose optimally are undercautious, choosing the more complex task when the less complex task had a higher expected payoff Furthermore, there is some weak evidence that cognitive ability is associated with more efficient choices of task complexity This efficiency measure is defined as the ratio of the expected payoff from the chosen task to the expected payoff from the optimal task, equaling one when the subject chooses optimally
Organizational Implications
The findings suggest that organizations and managers should actively design task menus, incentives for choosing more complex tasks, and feedback structures to account for how workers choose task complexity and sometimes overreach by choosing tasks that are too complex Specifically, they should pair the choice of more complex tasks with clear information and feedback such as historical success rates for comparable tasks or post-project reviews that distinguish poor task choice from poor task execution These features can help preserve the benefits of self-selection while helping workers learn when ambition is productive
Future Research Directions
The paper suggests directions for future work, including strategic interaction where the complexity of tasks chosen by coworkers directly affects a worker’s own payoffs Another direction concerns dynamic settings with learning and skill accumulation to understand when feedback corrects overreach and when it instead reinforces miscalibrated confidence The authors also note that the negative association between overconfidence and binary optimality is driven by undercautious overconfident subjects who choose the more complex task when the less complex task offers a higher expected payoff The paper concludes by stating that organizations can preserve the benefits of self-selection by pairing complex-task choices with clear information and feedback The authors also note that rewards for completing more complex tasks can help attract workers who are able to perform them, but they may also encourage overambitious workers to choose tasks for which the expected payoff is lower The paper's primary contribution is extending the literature on choice of task complexity by linking cognitive ability and overconfidence jointly to selection between complex tasks that differ in their success-payment tradeoff The authors also contribute to the literature on cognitive ability and decision making in complex settings by considering the link between cognitive ability and the optimality of task choice The paper documents a sharp asymmetry where subjects who err tend to overreach by choosing tasks that are too complex The authors also find that cognitive ability predicts realized earnings in both pairs, consistent with Proposition 3 The findings establish that cognitive ability and overconfidence are independent predictors of the choice of task complexity
Green — the paper says it, and the page is printed. Red — no passage carries it, so treat that sentence as unverified. The same check runs on your own text: check a summary against its source, $5.
Improvements for AI systems
-
Improved task selection systems can be designed to account for cognitive ability and overconfidence by pairing task menus with information and feedback that help workers assess their ability and probability of success. This preserves the benefits of self-selection while reducing costly overreach, as suggested by the paper's primary contribution.
-
AI systems can be trained to predict optimal task complexity based on a worker's cognitive ability, as the model predicts
the optimal level of task complexity weakly increases with cognitive ability.
This allows for personalized task assignment that aligns with an individual's skill level, preserving efficiency. -
Systems can incorporate overconfidence metrics to better gauge decision quality; specifically, the paper shows that
conditional on cognitive ability, more overconfident individuals also choose more complex tasks.
This helps in identifying when a worker is likely to be overambitious or undercautious. -
Feedback structures in AI systems should include historical success rates for comparable tasks and low-stakes trial assignments before full responsibility to help workers learn
when ambition is productive, when a more complex task is worth attempting, and when overconfidence might push them to be too ambitious.