Humans' ALMANAC: A Human Collaboration Dataset of Action-Level Mental Model Annotations for Agent Collaboration
cs.AI, cs.CL
Submitted: 2026-06-04
Updated: 2026-11-01
Terminology
Sources
- Consistently Simulating Human Personas with Multi-Turn Reinforcement Learning
- Can LLM Agents Simulate Multi-Turn Human Behavior? Evidence from Real Online Customer Behavior Data
- AI Simulations Grounded in Rich Self-Reports Increase Accuracy and Reduce Distortion
- A Benchmark to Assess Common Ground in Human-AI Collaboration
- AGENTIF: Benchmarking Instruction Following of Large Language Models in Agentic Scenarios
- ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIs
- Agentic Reasoning and Tool Integration for LLMs via Reinforcement Learning
- OPeRA: A Dataset of Observation, Persona, Rationale, and Action for Evaluating LLMs on Human Online Shopping Behavior Simulation
- CollabLLM: From Passive Responders to Active Collaborators
- A-MEM: Agentic Memory for LLM Agents
- Through the Lens of Human-Human Collaboration: A Configurable Research Platform for Exploring Human-Agent Collaboration
- $\tau$-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains
- WebArena: A Realistic Web Environment for Building Autonomous Agents
Related papers
- Multi-Objective Structured Pruning of LLMs for Latency and Model Size Optimization
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Embeddings for Preferences, Not Semantics
- Can We Trust Item Response Theory for AI Evaluation?
- Diagnosing Task Insensitivity in Language Agents