MAGMA-Bench: Evaluating Long-Horizon Embodied Agents under Dynamic Tasks and Execution Failures
cs.AI, cs.RO
Submitted: 2026-10-09
Updated: 2026-10-09
Project page: https://magma-rob.github.io/magma-bench
License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
Sources
- MemoryArena: Benchmarking Agent Memory in Interdependent Multi-Session Agentic Tasks
- Multi-Mission Tool Bench: Assessing the Robustness of LLM based Agents through Related and Dynamic Missions
- When Users Change Their Mind: Evaluating Interruptible Agents in Long-Horizon Web Navigation
- Gaia2: Benchmarking LLM Agents on Dynamic and Asynchronous Environments
- RoboMME: Benchmarking and Understanding Memory for Robotic Generalist Policies
- $\tau$-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains
- gpt-oss-120b & gpt-oss-20b Model Card
- Qwen3 Technical Report
- The Llama 3 Herd of Models
Related papers
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Agents' Last Exam
- The Clinician's Veto: Navigating Trust, Liability, and Uncertainty in Autonomous AI Prescribing
- MindHelper: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention
- Incumbent Advantage: Brand Bias and Cognitive Manipulation Dynamics in LLM Recommendation Systems