LEGION: Benchmarking Language Agents on Sparse-Signal Investigation Under Adversarial Noise
cs.AI
Submitted: 2026-11-09
Updated: 2026-11-09
Code: https://github.com/legion-security/legion-bench
Terminology
Sources
- GPT-4 Technical Report
- CTI-REALM: Benchmark to Evaluate Agent Performance on Security Detection Rule Generation Capabilities
- Evaluating Large Language Models Trained on Code
- A Survey on Code Generation with LLM-based Agents
- SWE-bench: Can Language Models Resolve Real-World GitHub Issues?
- VeriWeb: Verifiable Long-Chain Web Benchmark for Agentic Information-Seeking
- AgentBench: Evaluating LLMs as Agents
- Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context
- BrowseComp: A Simple Yet Challenging Benchmark for Browsing Agents
- ExCyTIn-Bench: Evaluating LLM agents on Cyber Threat Investigation
- Cybench: A Framework for Evaluating Cybersecurity Capabilities and Risks of Language Models
- GPT-4V(ision) is a Generalist Web Agent, if Grounded
- WebArena: A Realistic Web Environment for Building Autonomous Agents
Related papers
- Multi-Objective Structured Pruning of LLMs for Latency and Model Size Optimization
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Embeddings for Preferences, Not Semantics
- Can We Trust Item Response Theory for AI Evaluation?
- Diagnosing Task Insensitivity in Language Agents