The Percept-V Challenge: Can Multimodal LLMs Crack Simple Perception Problems?

Researchers tested state-of-the-art multimodal LLMs against human performance on Percept-V, a dataset of simple visual perception tasks. The findings reveal substantial gaps, showing MLLMs struggle with visual complexity and systematic limitations in basic perception skills compared to humans.

Open the full episode

More from AI Radio