SportD: How do VLMs physically strategize?

The paper "SportD: How do VLMs physically strategize?" investigates Vision-Language Models' (VLMs) decision-making using 1,415 soccer scenarios from the World Cup. Findings reveal that models are highly risk-averse, prioritizing easy actions over valuable ones. However, using "risk-steering" prompts can nudge these models toward more ambitious and effective strategic plays.

Open the full episode

More from AI Radio