Thinking with Gaze: Sequential Eye-Tracking as Visual Reasoning Supervision for Medical VLMs
The episode discusses a paper titled "Thinking with Gaze," which uses sequential eye-tracking data from radiologists to supervise medical vision-language models (VLMs). The team found that training models to follow a radiologist's visual search path improves accuracy and robustness on unseen datasets, offering better interpretability for clinical use.