CFOs Meet LLMs

summary

The gist

Business sentiment is a closely watched economic signal, but measuring it is slow and costly: surveys typically reach only a few hundred firms, arrive periodically…

In short

The study uses Large Language Models (LLMs) to predict individual Chief Financial Officer (CFO) responses regarding business sentiment, which is traditionally slow and costly to measure through surveys. The LLM framework generates a synthetic score that accurately predicts actual CFO answers at the individual level, showing predictive power even when controlling for macroeconomic factors.

Key concepts

LLM-generated optimism score
This is a metric produced by an LLM that simulates what a CFO would likely say. It goes beyond simple firm averages by predicting the specific answer of an individual CFO based on their company details and past responses, offering a more granular view of sentiment.
Conditioning on Executive History
A key technique where the LLM is fed the specific history and prior forecasts of an individual CFO. This anchors the model's prediction to that person's unique behavior rather than just a generic firm type, significantly boosting accuracy in predicting individual responses.
Dose-Response Relationship
This describes how increasing the amount of relevant information provided to the LLM affects its predictive accuracy. The results show that supplying more prior expectation data—specifically over three responses—monotonically increases the model's fit to actual CFO answers.
Synthetic Executives
The idea that LLMs can function as realistic, simulated executives. By conditioning them on rich context like firm and respondent-level details, they can serve as scalable tools for generating synthetic data to study economic sentiment in a way traditional surveys cannot.

Terminology used across episodes

This episode discusses

The paper

CFOs Meet LLMs · Read on arXiv

Duke University · Georgia State University

Business sentiment is closely watched, but measurement is slow and costly: surveys reach a limited number of firms, arrive periodically, and take time to field and compile. We show that large language models hold the potential to address some of these shortcomings. We prompt an LLM to role-play as the CFO of a specific company on a specific date, for every public-company CFO who responded to the Duke--Federal Reserve CFO Survey from 2002- 2025. We find that LLM-generated forecasts reasonably match the cross-section of CFO expectations, with accuracy increasing with the amount of information provided to the LLM.

Transcript

Introduction to the show: ident: Quantitative Finance. The day in quantitative finance: models of markets, risk and prices.

Ruth: We're looking at the paper: "CFOs Meet LLMs".

Warren: Here's the gist of the paper. Business sentiment is a closely watched economic signal, but measuring it is slow and costly: surveys typically reach only a few hundred firms, arrive periodically, and take time to compile The LLM-generated optimism score predicts the individual CFO’s actual answer, even in specifications that include firm and year-quarter fixed effects as well as a control variable measuring the human CFO’s lagged response.

Ruth: The LLM framework approximates how an executive is likely to respond given their information set and prior answers, providing an individual-level benchmark for the predictable component of managerial expectations.

Warren: The authors propose and evaluate a method for generating synthetic CFO expectations with large language models (LLMs).

Ruth: They prompt the LLM to role-play as the CFO of a specific public company at a specific point in time, supplying the model with the firm’s industry, revenue, headcount, and geographic footprint.

Paper summary: Ruth: What’s interesting is that this isn't just about getting a general market feeling; it’s about linking the digital twin sentiment to the human response in a very direct way >

Warren: They found that the predictive accuracy of this LLM forecast changes depending on how much information you give it, showing a dose-response relationship >

Iris: Specifically, when you supply the LLM model with three or more prior responses from that CFO, the fit increases to nearly fifty percent because that’s when it gets really accurate >

Ruth: It’s not just about the firm profile; they found that conditioning on each CFO respondent’s own history significantly anchors the persona to the individual rather than just a group type >

Warren: And when you look at it aggregated, even after controlling for things like macroeconomic benchmarks such as the Michigan Consumer Sentiment Index and some professional forecast of real GDP growth, the mean LLM optimism remains a significant predictor of mean CFO optimism >

Iris: They also validated this individual-level prediction within a single firm by matching every synthetic score to the response of the actual CFO at that same firm in that same quarter >

Ruth: So, they’re showing that even though these individual survey responses weren't used in training the model, these predictions are out-of-corpus with respect to those specific human answers >

Warren: That individual predictive content is what they point to as notable because it goes against prior work suggesting managerial expectations are just noisy reflections of public information >

Conclusion: Ruth: So, looking at "CFOs Meet LLMs," the main thing is that this method generates synthetic CFO expectations using large language models >

Warren: The key finding is that the LLM score is a significant predictor of the actual CFO’s response at the individual level >

Iris: And accuracy scales with how much information you provide to that AI model >

Ruth: Plus, aggregate results show that mean LLM optimism stays a significant predictor of mean CFO optimism even when you control for external economic benchmarks >

Warren: The paper suggests that in the future, these large language models might be useful as synthetic executives, especially when they are conditioned on a rich firm- and respondent-level context >

Iris: This offers the prospect of a real-time, scalable individual-level sentiment measure for both practitioners and policymakers >

More episodes

← Home