ArtifactArena: Evaluating Models by What They Build in the Physical World
cs.RO, cs.AI
Submitted: 2026-10-05
Updated: 2026-10-05
Sources
- Emergent Complexity via Multi-Agent Competition
- Evaluating Large Language Models Trained on Code
- PhysBench: Benchmarking and Enhancing Vision-Language Models for Physical World Understanding
- LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code
- DSPy: Compiling Declarative Language Model Calls into Self-Improving Pipelines
- KernelBench: Can LLMs Write Efficient GPU Kernels?
- MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmark
- CodeClash: Benchmarking Goal-Oriented Software Engineering
- Compositional Machine Design as Program Synthesis with LLMs
- SWE-Arena: An Interactive Platform for Evaluating Foundation Models in Software Engineering
Related papers
- FMT x: An Efficient and Asymptotically Optimal Extension of the Fast Marching Tree for Dynamic Replanning
- MPCFormer: A physics-informed data-driven approach for explainable socially-aware autonomous driving
- RoboLab: A High-Fidelity Simulation Benchmark for Analysis of Task Generalist Policies
- ARC: A Reasoning Recipe for Robot Foundation Models
- HRDexDB: A 4D Dexterous Grasping Dataset Across Human and Multiple Robot Embodiments
- APT: Action Expert Pretraining Improves Instruction Generalization of Vision-Language-Action Policies