When Do Causal World Models Help Modular LLM Agents
cs.AI
Submitted: 2026-07-12
Updated: 2026-07-12
Comments: Under Review
Code: https://github.com/Hik289/fed-causal-world
License: http://creativecommons.org/licenses/by/4.0/
The gist: LLM agents increasingly act through modular systems, such as order, payment, inventory, and shipment services, where actions in one module change which transitions are valid in another.
Terminology
Abstract
LLM agents increasingly act through modular systems, such as order, payment, inventory, and shipment services, where actions in one module change which transitions are valid in another. Standard world models usually fit observational traces, but this is not the quantity needed for intervention-time planning: a trace may show that payment precedes shipment without identifying whether payment authorizes shipment, inventory mediates the effect, or a hidden trigger explains both. We study this gap through FedCausalCompose, a causal world-model framework for modular LLM agents in which local actions provide intervention-response evidence for cross-module interfaces. We first show that observational world models incur an irreducible interventional error under unblocked back-door paths, that interface recovery improves with intervention-response coverage, and that an oracle causal composition can beat the non-causal lower bound when coverage and local mechanism errors are controlled. We then test the resulting prediction in diagnostic agent settings. Causal interfaces help most in structured tool environments, where API signatures expose preconditions and downstream effects. In contrast, dialogue and narrative environments often ignore raw edge lists unless a short attention anchor makes the causal information decision-relevant. These results identify a concrete condition for causal world models in LLM agents: causal structure helps when cross-module interfaces are both statistically identifiable and presented in a form the agent can use at action time.
Sources
- Invariant Risk Minimization
- PatchWorld: Gradient-Free Optimization of Executable World Models for Agent Environments
- Regret-Based Federated Causal Discovery with Unknown Interventions
- $\tau^2$-Bench: Evaluating Conversational Agents in a Dual-Control Environment
- LLM-State: Open World State Representation for Long-horizon Task Planning with Large Language Model
- Federated Causal Discovery Across Heterogeneous Datasets under Latent Confounding
- Text2World: Benchmarking Large Language Models for Symbolic World Model Generation
- API-Bank: A Comprehensive Benchmark for Tool-Augmented LLMs
- ToolSandbox: A Stateful, Conversational, Interactive Evaluation Benchmark for LLM Tool Use Capabilities
- R-WoM: Retrieval-augmented World Model For Computer-use Agents
- Provably Efficient Causal Model-Based Reinforcement Learning for Systematic Generalization
- Causal Discovery in Heterogeneous Environments Under the Sparse Mechanism Shift Hypothesis
- AndroidWorld: A Dynamic Benchmarking Environment for Autonomous Agents
- Global existence and blow-up of solutions to pseudo-parabolic equation for Baouendi-Grushin operator
- ScienceWorld: Is your Agent Smarter than a 5th Grader?
- Can Language Models Serve as Text-Based World Simulators?
- $\tau$-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains
- Dyna-Think: Synergizing Reasoning, Acting, and World Model Simulation in AI Agents
- Explainable Reinforcement Learning via a Causal World Model
Related papers
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Agents' Last Exam
- The Clinician's Veto: Navigating Trust, Liability, and Uncertainty in Autonomous AI Prescribing
- MindHelper: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention
- Incumbent Advantage: Brand Bias and Cognitive Manipulation Dynamics in LLM Recommendation Systems