Anchor: Preventing Artifact Drift for Reliable Agent Verification
cs.AI
Submitted: 2026-05-25
Updated: 2026-11-15
Comments: Accepted to the NeurIPS 2026 Workshop on Who Verifies the Agents?
Code: https://github.com/badlogic/pi-mono
License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
Terminology
Sources
- SWE-Bench+: Enhanced Coding Benchmark for LLMs
- $\tau^2$-Bench: Evaluating Conversational Agents in a Dual-Control Environment
- SWE-bench: Can Language Models Resolve Real-World GitHub Issues?
- Beyond Accuracy: A Multi-Dimensional Framework for Evaluating Enterprise Agentic AI Systems
- Measuring Agents in Production
- Continuous Benchmark Generation for Evaluating Enterprise-scale LLM Agents
- AgentSynth: Scalable Task Generation for Generalist Computer-Use Agents
- TheAgentCompany: Benchmarking LLM Agents on Consequential Real World Tasks
- $\tau$-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains
- Survey on Evaluation of LLM-based Agents
- UTBoost: Rigorous Evaluation of Coding Agents on SWE-Bench
- Establishing Best Practices for Building Rigorous Agentic Benchmarks
Related papers
- Multi-Objective Structured Pruning of LLMs for Latency and Model Size Optimization
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Embeddings for Preferences, Not Semantics
- Can We Trust Item Response Theory for AI Evaluation?
- Diagnosing Task Insensitivity in Language Agents