Brain-IT-VQA: From Brain Signals to Answers

Name: Brain-IT-VQA: From Brain Signals to Answers
Uploaded: 2026-10-06T10:36:27.769053+00:00
Duration: 820 s
Description: Brain-IT-VQA decodes visual questions from fMRI signals by translating brain activity into language tokens and integrating them with a vision-language model. It uses a novel benchmark, NSD-VQA, to test how different brain regions encode visual information, showing that coarse scene understanding is easier to decode than fine details.

Brain-IT-VQA decodes visual questions from fMRI signals by translating brain activity into language tokens and integrating them with a vision-language model. It uses a novel benchmark, NSD-VQA, to test how different brain regions encode visual information, showing that coarse scene understanding is easier to decode than fine details.

Open the full episode