Evaluating Physically Grounded Procedural Reasoning in VLMs through Real-World Execution: Crochet as a Testbed
cs.CL, cs.CV
Submitted: 2026-11-07
Updated: 2026-11-07
Code: https://github.com/InternRobotics/InternVLA-A1.5
Terminology
Sources
- Can AI Understand the Language of Origami?
- Emerging Properties in Self-Supervised Vision Transformers
- Evaluating Large Language Models Trained on Code
- Tinted Frames: Question Framing Blinds Vision-Language Models
- 3DCodeBench: Benchmarking Agentic Procedural 3D Modeling Via Code
- Benchmarking and Mechanistic Analysis of Vision-Language Models for Cross-Depiction Assembly Instruction Alignment
- DINOv2: Learning Robust Visual Features without Supervision
- A Fine-Grained Hierarchy and Benchmark for State Tracking in Language Models
- Vision language models are blind: Failing to translate detailed visual features into words
- Pro$^2$Assist: Continuous Step-aware Proactive Assistance with Multi-modal Egocentric Perception for Long-horizon Procedural Tasks
- BenchCAD: A Comprehensive, Industry-Standard Benchmark for Programmatic CAD
Related papers
- ALARM: Audio-Language Alignment for Reasoning Models
- ThinkSum: Probabilistic reasoning over sets using large language models
- Coherence boosting: When your pretrained language model is not paying enough attention
- From Facts to Insights: A Persona-Driven Dual Memory Framework and Dataset for Role-Playing Agents
- Improving General Role-Playing Agents via Psychology-Grounded Reasoning and Role-Aware Policy Optimization
- The Art of Asking: Multilingual Prompt Optimization for Synthetic Data