BigCodeArena: Unveiling More Reliable Human Preferences in Code Generation via Execution
cs.SE, cs.AI, cs.CL
Submitted: 2025-10-09
Updated: 2026-11-13
Code: https://github.com/bigcode-project/bigcodearena
Terminology
Sources
- SantaCoder: don't reach for the stars!
- Qwen Technical Report
- Qwen2.5-VL Technical Report
- Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback
- DeepSeek LLM: Scaling Open-Source Language Models with Longtermism
- Evaluating Large Language Models Trained on Code
- Copilot Arena: A Platform for Code LLM Evaluation in the Wild
- 3D Arena: An Open Platform for Generative 3D Evaluation
- Qwen2.5-Coder Technical Report
- GPT-4o System Card
- OpenAI o1 System Card
- LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code
- S2S-Arena: Evaluating Paralinguistic Instruction Following in Speech-to-Speech Models
- Learning Code Preference via Synthetic Evolution
- StarCoder 2 and The Stack v2: The Next Generation
- RewardBench 2: Advancing Reward Model Evaluation
- StarVector: Generating Scalable Vector Graphics Code from Images and Text
- Design2Code: Benchmarking Multimodal Code Generation for Automated Front-End Engineering
- MiMo-VL Technical Report
- Kimi-VL Technical Report
Related papers
- ArkEval: Benchmarking and Evaluating Automated CodeRepair for ArkTS
- TestPrism: Rethinking Test Evaluation Beyond a Single Reference
- Mining Workflow Graphs for Black-Box Boundary Testing of Conversational LLM Agents
- Falsification-Based Verification of LLM-Generated Optimization Models: Sound Test Batteries and Their Detection Limits
- GitSkills: A Dataset of Agent Skills on GitHub
- For Coding Agents, the Repository Matters