Vision Language Models Cannot Plan, but Can They Formalize?
This episode discusses a paper exploring whether Vision Language Models can create structured plans for complex tasks. The hosts conclude that while direct planning fails, using a 'formalizer' approach—translating visual scenes into PDDL—is highly reliable. However, the models' incomplete vision remains the primary bottleneck.