Embodied Zero-Shot Task Planning via Hardware-Aware LLM-VLM Integration for Grounded Robotic Manipulation
cs.RO, cs.AI
Submitted: 2026-10-08
Updated: 2026-10-08
Code: https://github.com/Ltankersley15/SK-Zero-Shot-Research
Terminology
Sources
- Do As I Can, Not As I Say: Grounding Language in Robotic Affordances
- ProgPrompt: Generating Situated Robot Task Plans using Large Language Models
- Inner Monologue: Embodied Reasoning through Planning with Language Models
- VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Models
- PaLM-E: An Embodied Multimodal Language Model
- RT-1: Robotics Transformer for Real-World Control at Scale
- OpenVLA: An Open-Source Vision-Language-Action Model
- $\pi_0$: A Vision-Language-Action Flow Model for General Robot Control
- SAM 2: Segment Anything in Images and Videos
- Robots That Ask For Help: Uncertainty Alignment for Large Language Model Planners
Related papers
- FMT x: An Efficient and Asymptotically Optimal Extension of the Fast Marching Tree for Dynamic Replanning
- MPCFormer: A physics-informed data-driven approach for explainable socially-aware autonomous driving
- RoboLab: A High-Fidelity Simulation Benchmark for Analysis of Task Generalist Policies
- ARC: A Reasoning Recipe for Robot Foundation Models
- HRDexDB: A 4D Dexterous Grasping Dataset Across Human and Multiple Robot Embodiments
- APT: Action Expert Pretraining Improves Instruction Generalization of Vision-Language-Action Policies