Reward Design for Physical Reasoning in Vision-Language Models
The study compared four reward signals—format compliance, answer accuracy, a composite rubric reward, and an internal attention-based reward—to improve physical reasoning in Vision-Language Models. Results showed that accuracy rewards provided the biggest gains overall. The internal attention reward offered a useful grounding signal for spatial reasoning and complemented external supervision.