OODBench: Out-of-Distribution Benchmark for Large Vision-Language Models
The episode discusses OODBench, a benchmark for Large Vision-Language Models that tests their performance on out-of-distribution data—common objects in uncommon situations. Hosts discuss how models perform poorly on this difficult data and how the benchmark uses other AI models to detect out-of-distribution samples. The paper suggests improving visual understanding rather than just reasoning.