SituRecBench: Evaluating Frontier Models as Situated Recommendation Assistants in 3D Environments
cs.AI, cs.CL, cs.CV, cs.IR, cs.LG
Submitted: 2026-11-07
Updated: 2026-11-07
Code: https://github.com/Farama-Foundation/chatarena
Project page: https://siturec.github.io/SituRecBench/Abstract
Terminology
Sources
- MarketGen: A Scalable Simulation Platform with Auto-Generated Embodied Supermarket Environments
- S$^3$IT: A Benchmark for Spatially Situated Social Intelligence Test
- $\tau$-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains
- Set-of-Mark Prompting Unleashes Extraordinary Visual Grounding in GPT-4V
- Qwen3-VL Technical Report
- Gemma 4 Technical Report
- UserBench: An Interactive Gym Environment for User-Centric Agents
Related papers
- Multi-Objective Structured Pruning of LLMs for Latency and Model Size Optimization
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Embeddings for Preferences, Not Semantics
- Can We Trust Item Response Theory for AI Evaluation?
- Diagnosing Task Insensitivity in Language Agents