PersonaCodeBench: Evaluating Coding Agents in Persona-driven Human-Interactive Sessions
cs.AI
Submitted: 2026-11-03
Updated: 2026-11-03
Code: https://github.com/MatrAIx-ai/PersonaCodeBench
Terminology
Sources
- Eval4Sim: An Evaluation Framework for Persona Simulation
- $\tau^2$-Bench: Evaluating Conversational Agents in a Dual-Control Environment
- SWE-chat: Coding Agent Interactions From Real Users in the Wild
- Copilot Arena: A Platform for Code LLM Evaluation in the Wild
- SWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?
- SimulatorArena: Are User Simulators Reliable Proxies for Multi-Turn Evaluation of AI Assistants?
- LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code
- SWE-bench: Can Language Models Resolve Real-World GitHub Issues?
- PersonaCUABench: Benchmarking Computer-Use Agents Serving Diverse Personas
- RepoLaunch: Automating Build and Management of Code Repositories across Languages and Platforms
- iPrefBench: A User-Centric Benchmark for Personalized Mobile Use Agents
- SlopCodeBench: Benchmarking How Coding Agents Degrade Over Long-Horizon Iterative Tasks
- UserBench: An Interactive Gym Environment for User-Centric Agents
- SWE-INTERACT: Reimagining SWE Benchmarks as User-Driven Long-Horizon Coding Sessions
- WildFeedback: Aligning LLMs With In-situ User Interactions And Feedback
- ACLArena: Agent Continue Learning in Multi-stage Post-training
- SWE-Together: Evaluating Coding Agents in Interactive User Sessions
- $\tau$-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains
- SWE-bench Goes Live!
- SWEET-RL: Training Multi-Turn LLM Agents on Collaborative Reasoning Tasks
Related papers
- Multi-Objective Structured Pruning of LLMs for Latency and Model Size Optimization
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Embeddings for Preferences, Not Semantics
- Can We Trust Item Response Theory for AI Evaluation?
- Diagnosing Task Insensitivity in Language Agents