FINCOSMOS: An Open-World Evaluation Paradigm for Agents in Finance
cs.AI, cs.CL, q-fin.CP
Submitted: 2026-11-05
Updated: 2026-11-05
Terminology
Sources
- $\tau^2$-Bench: Evaluating Conversational Agents in a Dual-Control Environment
- Finance Agent Benchmark: Benchmarking LLMs on Real-world Financial Research Tasks
- FinTrace: Holistic Trajectory-Level Evaluation of LLM Tool Calling for Long-Horizon Financial Tasks
- DeepResearch Bench: A Comprehensive Benchmark for Deep Research Agents
- Assessing Look-Ahead Bias in Stock Return Predictions Generated By GPT Sentiment Analysis
- ShiJianBench: From Dialogue to Decision for Long-Horizon Evaluation of Investment Advisors
- BizFinBench.v2: Towards Reliable LLMs in Finance via Real-User Data and Offline/Online Bilingual Evaluation
- Can LLM Agents Be CFOs? Benchmarking Long-Horizon Resource Allocation in an Uncertain Enterprise Environment
- Are LLMs Good Financial User Simulators? Multi-view Investor Logic Alignment (MILA)
- Chronologically Consistent Large Language Models
- FinanceBench: A New Benchmark for Financial Question Answering
- HindsightBench: A Black-Box Behavioral Audit Protocol for Parametric Hindsight in Time-Indexed LLM Decision Tasks
- FinSight: Towards Real-World Financial Deep Research
- Evaluating LLMs in Finance Requires Explicit Bias Consideration
- LLMs Get Lost In Multi-Turn Conversation
- Time Travel is Cheating: Going Live with DeepFund for Real-Time Fund Investment Benchmarking
- Can LLM-based Financial Investing Strategies Outperform the Market in Long Run?
- Summoning the Oracle to Slay It: Mitigating Look-Ahead Bias in Financial Backtesting with Large Language Models
Related papers
- Multi-Objective Structured Pruning of LLMs for Latency and Model Size Optimization
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Embeddings for Preferences, Not Semantics
- Can We Trust Item Response Theory for AI Evaluation?
- Diagnosing Task Insensitivity in Language Agents