DelegateEval: Evaluating Platforms for Personal External Service Agents
cs.AI
Submitted: 2026-11-05
Updated: 2026-11-07
Terminology
Sources
- SWE-bench: Can Language Models Resolve Real-World GitHub Issues?
- AppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding Agents
- TheAgentCompany: Benchmarking LLM Agents on Consequential Real World Tasks
- LoRA: Low-Rank Adaptation of Large Language Models
- Magentic Marketplace: An Open-Source Environment for Studying Agentic Markets
- Intelligent AI Delegation
- AgentDojo: A Dynamic Environment to Evaluate Prompt Injection Attacks and Defenses for LLM Agents
- AI Agents That Matter
- Generative AI at Work
- Deep Fusion Memory: A Chunk-Level Parametric Memory for Large Language Models
Related papers
- Multi-Objective Structured Pruning of LLMs for Latency and Model Size Optimization
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Embeddings for Preferences, Not Semantics
- Can We Trust Item Response Theory for AI Evaluation?
- Diagnosing Task Insensitivity in Language Agents