Grounding Large Language Models in DSGE Simulators for Policy Generation and Forecasting
cs.AI, cs.CE, cs.LG
Submitted: 2026-10-01
Updated: 2026-10-01
Code: https://github.com/vasudeywos/Grounding_LLM_in_DSGE_Simulators_for_Policy_Generation_and_
License: http://creativecommons.org/licenses/by/4.0/
The gist: Large language models can produce economic policy responses that sound reasonable, but this does not show that their actions are consistent with economic dynamics.
Terminology
Abstract
Large language models can produce economic policy responses that sound reasonable, but this does not show that their actions are consistent with economic dynamics. We test this by placing an instruction-tuned language model inside six Snowdrop-backed dynamic stochastic general equilibrium (DSGE) simulators. At each turn, the model observes the economy and a change in economic discourse, selects a bounded policy action, and receives the next simulated state and an economic reward. We implement a common Python interface for repeated rollouts, persistent shocks, state cloning, and rolling-horizon simulation. This setting creates a long-horizon credit-assignment problem. Policy effects may appear several quarters after an action is taken. PPO has a learned value function that can propagate delayed reward to earlier tokens through generalized advantage estimation. GRPO has no learned value function and instead assigns a group-relative advantage from complete rollout returns. It therefore cannot distinguish which earlier turn caused the outcome; if every rollout receives the same return, the normalized advantage is zero. We use PPO as the primary method and GRPO as a matched critic-free baseline. The experiments also test directional semantic signals, reward horizon, trajectory warm starts, cross-simulator transfer, and historically anchored pandemic and monetary-policy shocks. The objective is to judge policy actions by their simulated economic consequences rather than by plausible language alone.
Sources
- Hindsight Experience Replay
- RUDDER: Return Decomposition for Delayed Rewards
- Grounding Large Language Models in Interactive Environments with Online Reinforcement Learning
- Stories that (are) Move(d by) Markets: A Causal Exploration of Market Shocks and Semantic Shifts across Different Partisan Groups
- SAC-GLAM: Improving Online RL for LLM agents with Soft Actor-Critic and Hindsight Relabeling
- LoRA: Low-Rank Adaptation of Large Language Models
- Beyond Surface Similarity: Detecting Subtle Semantic Shifts in Financial Narratives
- LLM and Simulation as Bilevel Optimizers: A New Paradigm to Advance Physical Scientific Discovery
- RL Squeezes, SFT Expands: A Comparative Study of Reasoning LLMs
- Training language models to follow instructions with human feedback
- Curiosity-driven Exploration by Self-supervised Prediction
- Qwen2.5 Technical Report
- Proximal Policy Optimization Algorithms
- DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models
- A Practitioner's Guide to Multi-turn Agentic Reinforcement Learning
- Reinforcing Multi-Turn Reasoning in LLM Agents via Turn-Level Reward Design
- Your Group-Relative Advantage Is Biased
Related papers
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Agents' Last Exam
- The Clinician's Veto: Navigating Trust, Liability, and Uncertainty in Autonomous AI Prescribing
- MindHelper: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention
- Incumbent Advantage: Brand Bias and Cognitive Manipulation Dynamics in LLM Recommendation Systems