BASIS: Evaluating Belief-Aware Solutions in Interactive Settings beyond Instructions
The work introduces BASIS, a benchmark to test if AI agents can understand users' mental states and recognize when their beliefs mismatch reality. It shows that simply following instructions fails; success requires inferring user beliefs and using that understanding to find better solutions. The findings prove that knowing the user's perspective is crucial for reliable assistance.