CFOs Meet LLMs
summary
The gist
Business sentiment is a closely watched economic signal, but measuring it is slow and costly: surveys typically reach only a few hundred firms, arrive periodically…
In short
The study uses Large Language Models (LLMs) to predict individual Chief Financial Officer (CFO) responses regarding business sentiment, which is traditionally slow and costly to measure through surveys. The LLM framework generates a synthetic score that accurately predicts actual CFO answers at the individual level, showing predictive power even when controlling for macroeconomic factors.
Key concepts
- LLM-generated optimism score
- This is a metric produced by an LLM that simulates what a CFO would likely say. It goes beyond simple firm averages by predicting the specific answer of an individual CFO based on their company details and past responses, offering a more granular view of sentiment.
- Conditioning on Executive History
- A key technique where the LLM is fed the specific history and prior forecasts of an individual CFO. This anchors the model's prediction to that person's unique behavior rather than just a generic firm type, significantly boosting accuracy in predicting individual responses.
- Dose-Response Relationship
- This describes how increasing the amount of relevant information provided to the LLM affects its predictive accuracy. The results show that supplying more prior expectation data—specifically over three responses—monotonically increases the model's fit to actual CFO answers.
- Synthetic Executives
- The idea that LLMs can function as realistic, simulated executives. By conditioning them on rich context like firm and respondent-level details, they can serve as scalable tools for generating synthetic data to study economic sentiment in a way traditional surveys cannot.
Terminology used across episodes
This episode discusses
The paper
CFOs Meet LLMs · Read on arXiv
Duke University · Georgia State University
Business sentiment is closely watched, but measurement is slow and costly: surveys reach a limited number of firms, arrive periodically, and take time to field and compile. We show that large language models hold the potential to address some of these shortcomings. We prompt an LLM to role-play as the CFO of a specific company on a specific date, for every public-company CFO who responded to the Duke--Federal Reserve CFO Survey from 2002- 2025. We find that LLM-generated forecasts reasonably match the cross-section of CFO expectations, with accuracy increasing with the amount of information provided to the LLM.
Transcript
Introduction to the show: ident: Quantitative Finance. The day in quantitative finance: models of markets, risk and prices.
Ruth: We're looking at the paper: "CFOs Meet LLMs".
Warren: Here's the gist of the paper. Business sentiment is a closely watched economic signal, but measuring it is slow and costly: surveys typically reach only a few hundred firms, arrive periodically, and take time to compile The LLM-generated optimism score predicts the individual CFO’s actual answer, even in specifications that include firm and year-quarter fixed effects as well as a control variable measuring the human CFO’s lagged response.
Ruth: The LLM framework approximates how an executive is likely to respond given their information set and prior answers, providing an individual-level benchmark for the predictable component of managerial expectations.
Warren: The authors propose and evaluate a method for generating synthetic CFO expectations with large language models (LLMs).
Ruth: They prompt the LLM to role-play as the CFO of a specific public company at a specific point in time, supplying the model with the firm’s industry, revenue, headcount, and geographic footprint.
Paper summary: Ruth: What’s interesting is that this isn't just about getting a general market feeling; it’s about linking the digital twin sentiment to the human response in a very direct way >
Warren: They found that the predictive accuracy of this LLM forecast changes depending on how much information you give it, showing a dose-response relationship >
Iris: Specifically, when you supply the LLM model with three or more prior responses from that CFO, the fit increases to nearly fifty percent because that’s when it gets really accurate >
Ruth: It’s not just about the firm profile; they found that conditioning on each CFO respondent’s own history significantly anchors the persona to the individual rather than just a group type >
Warren: And when you look at it aggregated, even after controlling for things like macroeconomic benchmarks such as the Michigan Consumer Sentiment Index and some professional forecast of real GDP growth, the mean LLM optimism remains a significant predictor of mean CFO optimism >
Iris: They also validated this individual-level prediction within a single firm by matching every synthetic score to the response of the actual CFO at that same firm in that same quarter >
Ruth: So, they’re showing that even though these individual survey responses weren't used in training the model, these predictions are out-of-corpus with respect to those specific human answers >
Warren: That individual predictive content is what they point to as notable because it goes against prior work suggesting managerial expectations are just noisy reflections of public information >
Conclusion: Ruth: So, looking at "CFOs Meet LLMs," the main thing is that this method generates synthetic CFO expectations using large language models >
Warren: The key finding is that the LLM score is a significant predictor of the actual CFO’s response at the individual level >
Iris: And accuracy scales with how much information you provide to that AI model >
Ruth: Plus, aggregate results show that mean LLM optimism stays a significant predictor of mean CFO optimism even when you control for external economic benchmarks >
Warren: The paper suggests that in the future, these large language models might be useful as synthetic executives, especially when they are conditioned on a rich firm- and respondent-level context >
Iris: This offers the prospect of a real-time, scalable individual-level sentiment measure for both practitioners and policymakers >
More episodes
- The day in conversation for 2026-11-19
- Daily Summary for 2026-11-19
- The day in conversation for 2026-11-18
- Daily Summary for 2026-11-18
- 2601.05274-On the use of case estimate and transactional payment data in neural networks for individual loss reserving
- 2009.00868-Loss-Given-Default Modeling by Post-Last Passage Time Process
- 2606.30070-Financial Resilience Evaluation: From Conditional Expectations to Dynamic Convex Risk Measures
- 2212.12687-Measuring price impact and information content of trades in a time-varying setting
- Daily Summary for 2026-11-17
- 2401.08323-Dynamic portfolio selection under generalized disappointment aversion