ViBench 2.0: A Benchmark for Long-Horizon Software Building
cs.AI, cs.SE
Submitted: 2026-11-03
Updated: 2026-11-03
Code: https://github.com/ViBench/vibench-public
Terminology
Sources
- You Don't Know Until You Click:Automated GUI Testing for Production-Ready Software Evaluation
- GAUGE: When Not to Trust LLM-as-a-Judge in User-Simulated Evaluation of Task-Oriented Agents
- FeatBench: Towards More Realistic Evaluation of Feature-level Code Generation
- Evaluating Large Language Models Trained on Code
- SWE-Marathon: Can Agents Autonomously Complete Ultra-Long-Horizon Software Work?
- How Benchmarks Mis-Score Computer-Use Agents
- Vibe Coding in Practice: Motivations, Challenges, and a Future Outlook -- a Grey Literature Review
- VISTA: An End-to-End Benchmark for Visual Spec-to-Web-App Coding Agents
- SWE-EVO: Benchmarking Coding Agents in Long-Horizon Software Evolution Scenarios
- WebCraftBench: Evaluating Web Application Generation from a Software Testing Perspective
- EvoWeb: A Benchmark for Coding Agents on Evolving Web Applications
- ICAE-Bench: Evaluating Coding Agents as Interactive Project Builders
- Good Vibrations? A Qualitative Study of Co-Creation, Communication, Flow, and Trust in Vibe Coding
- ProductWebBench: Evaluating Website Continuity Beyond Task Completion
- SWE-Together: Evaluating Coding Agents in Interactive User Sessions
- Web-Bench: A LLM Code Benchmark Based on Web Standards and Frameworks
- ProgramBench: Can Language Models Rebuild Programs From Scratch?
- $\tau$-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains
- ArtifactsBench: Bridging the Visual-Interactive Gap in LLM Code Generation Evaluation
Related papers
- Multi-Objective Structured Pruning of LLMs for Latency and Model Size Optimization
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Embeddings for Preferences, Not Semantics
- Can We Trust Item Response Theory for AI Evaluation?
- Diagnosing Task Insensitivity in Language Agents