ASTRA-bench: Evaluating Tool-Use Agent Reasoning and Action Planning with Personal User Context
cs.AI
Submitted: 2026-03-02
Updated: 2026-11-05
Terminology
Sources
- GPT-4 Technical Report
- ARE: Scaling Up Agent Environments and Evaluations
- Vending-Bench: A Benchmark for Long-Term Coherence of Autonomous Agents
- Qwen Technical Report
- $\tau^2$-Bench: Evaluating Conversational Agents in a Dual-Control Environment
- BERT for Joint Intent Classification and Slot Filling
- ToolTalk: Evaluating Tool-Usage in a Conversational Setting
- Planning, Creation, Usage: Benchmarking LLMs for Comprehensive Tool Utilization in Real-World Complex Scenarios
- GPT-4o System Card
- API-Bank: A Comprehensive Benchmark for Tool-Augmented LLMs
- DeepSeek-V3.2: Pushing the Frontier of Open Large Language Models
- AgentBench: Evaluating LLMs as Agents
- ToolSandbox: A Stateful, Conversational, Interactive Evaluation Benchmark for LLM Tool Use Capabilities
- Exploring the Potential of LLMs as Personalized Assistants: Dataset, Evaluation, and Analysis
- WebGPT: Browser-assisted question-answering with human feedback
- ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIs
- Toolformer: Language Models Can Teach Themselves to Use Tools
- LaMDA: Language Models for Dialog Applications
- AppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding Agents
- Rethinking Stateful Tool Use in Multi-Turn Dialogues: Benchmarks and Challenges
Related papers
- Multi-Objective Structured Pruning of LLMs for Latency and Model Size Optimization
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Embeddings for Preferences, Not Semantics
- Can We Trust Item Response Theory for AI Evaluation?
- Diagnosing Task Insensitivity in Language Agents