The Percept-V Challenge: Can Multimodal LLMs Crack Simple Perception Problems?
Researchers tested state-of-the-art multimodal LLMs against human performance on Percept-V, a dataset of simple visual perception tasks. The findings reveal substantial gaps, showing MLLMs struggle with visual complexity and systematic limitations in basic perception skills compared to humans.