4MT-VLM: How Coarse Is a VLMs Cognitive Map?
Researchers tested vision-language models' ability to recognize a place from a viewpoint they haven't seen by moving the camera. The models struggled to maintain spatial understanding across different angles, showing that their cognitive maps are too coarse for agents needing true spatial memory.