SlackBench: Benchmarking Agents on Collaborative Projects Grounded in Real Code Repositories
cs.AI, cs.CL
Submitted: 2026-11-03
Updated: 2026-11-03
Code: https://github.com/harborframework/harbor
Terminology
Sources
- BrowseComp: A Simple Yet Challenging Benchmark for Browsing Agents
- MEMTRACK: Evaluating Long-Term Memory and State Tracking in Multi-Platform Dynamic Agent Environments
- APEX-Agents
- Workspace-Bench 1.0: Benchmarking AI Agents on Workspace Tasks with Large-Scale File Dependencies
- Agent-Diff: Benchmarking LLM Agents on Enterprise API Tasks via Code Execution with State-Diff-Based Evaluation
- ASTRA-bench: Evaluating Tool-Use Agent Reasoning and Action Planning with Personal User Context
- SkillsBench: Benchmarking How Well Agent Skills Work Across Diverse Tasks
- GLM-5: from Vibe Coding to Agentic Engineering
- DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligence
Related papers
- Multi-Objective Structured Pruning of LLMs for Latency and Model Size Optimization
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Embeddings for Preferences, Not Semantics
- Can We Trust Item Response Theory for AI Evaluation?
- Diagnosing Task Insensitivity in Language Agents