EnterpriseBench: Benchmarking LLM Agents on Enterprise-Level Strategic Reasoning and Decision-Making
cs.AI
Submitted: 2026-09-29
Updated: 2026-10-03
Code: https://github.com/sduyangmin/FirmBench
License: http://creativecommons.org/licenses/by/4.0/
The gist: LLM agents are increasingly expected to support enterprise workflows, where tasks often involve missing information, uncertainty, feedback, and long-term trade-offs.
Terminology
Abstract
LLM agents are increasingly expected to support enterprise workflows, where tasks often involve missing information, uncertainty, feedback, and long-term trade-offs. However, existing enterprise and financial benchmarks mainly test static capabilities such as information extraction, numerical calculation, domain knowledge, and financial QA, leaving interactive and long-horizon decision-making underexplored. To bridge this gap, we introduce EnterpriseBench, a benchmark that evaluates LLM agents across this spectrum, from static question answering to dynamic decision-making. Specifically, EnterpriseBench reorganizes existing enterprise and financial QA datasets into a unified foundational suite annotated by capability and difficulty, and introduces three professional interactive settings: Consulting, based on management-consulting-style business cases for client problem diagnosis through multi-turn information seeking; the Beer Game, adapted from a classic supply-chain management simulation for inventory control under delayed feedback; and Enterprise Digital Twin, a project-based business simulator for workforce, risk, and project planning. Experiments with nine agent methods under four backbone models show that current agents have not yet achieved stable, comprehensive, and cross-task reliability in enterprise scenarios. These results show that EnterpriseBench provides a practical benchmark for evaluating LLM agents in realistic enterprise strategic reasoning and decision-making.
Sources
- xbench: Tracking Agents Productivity Scaling with Profession-Aligned Real-World Evaluations
- StockBench: Can LLM Agents Trade Stocks Profitably In Real-world Markets?
- BabyAI: A Platform to Study the Sample Efficiency of Grounded Language Learning
- DeepSeek-V3 Technical Report
- WebChoreArena: Evaluating Web Browsing Agents on Realistic Tedious Web Tasks
- ALFWorld: Aligning Text and Embodied Environments for Interactive Learning
- FinTagging: Benchmarking LLMs for Extracting and Structuring Financial Information
- TradingAgents: Multi-Agents LLM Financial Trading Framework
- ExpertPrompting: Instructing Large Language Models to be Distinguished Experts
- Qwen3 Technical Report
- Agent Learning via Early Experience
Related papers
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Agents' Last Exam
- The Clinician's Veto: Navigating Trust, Liability, and Uncertainty in Autonomous AI Prescribing
- MindHelper: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention
- Incumbent Advantage: Brand Bias and Cognitive Manipulation Dynamics in LLM Recommendation Systems