BEAKER: An Expert-Curated Benchmark for Embodied Brains in Self-Driving Chemical Laboratories
cs.AI
Submitted: 2026-11-04
Updated: 2026-11-04
Code: https://github.com/HydroSophy/BEAKER
Terminology
Sources
- ACE-Brain-0: Spatial Intelligence as a Shared Scaffold for Universal Embodiments
- ACE-Brain-0.5: A Unified Embodied Foundational Model for Physical Agentic AI
- Visual Embodied Brain: Let Multimodal Large Language Models See, Think, and Control in Spaces
- RoboBrain 2.0 Technical Report
- AffordBot: 3D Fine-grained Embodied Reasoning via Multimodal Large Language Models
- RoboChemist: Long-Horizon and Safety-Compliant Robotic Chemical Experimentation
- PREVENT: Proactive Risk Evaluation and Vigilant Execution of Tasks for Mobile Robotic Chemists using Multi-Modal Behavior Trees
- AgentChemist: A Multi-Agent Experimental Robotic Platform Integrating Chemical Perception and Precise Control
- ORGANA: A Robotic Assistant for Automated Chemistry Experimentation and Characterization
- AutoLabs: Cognitive Multi-Agent Systems with Self-Correction for Autonomous Chemical Experimentation
- LABSHIELD: A Multimodal Benchmark for Safety-Critical Reasoning and Planning in Scientific Laboratories
- ExpVid: A Benchmark for Experiment Video Understanding & Reasoning
- GPT-4 Technical Report
- Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context
- Kimi-VL Technical Report
- Qwen2.5-VL Technical Report
- InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiency
- LoopVL: Recurrent Visual Intelligence
- Intern-S1: A Scientific Multimodal Foundation Model
- Intern-S1-Pro: Scientific Multimodal Foundation Model at Trillion Scale
Related papers
- Multi-Objective Structured Pruning of LLMs for Latency and Model Size Optimization
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Embeddings for Preferences, Not Semantics
- Can We Trust Item Response Theory for AI Evaluation?
- Diagnosing Task Insensitivity in Language Agents