MUSE: Benchmarking Assembly Structure and Interface Geometry in Multi-Component Text-to-CAD Generation
cs.AI
Submitted: 2026-05-27
Updated: 2026-10-19
Comments: 31 pages
Project page: https://dong7313.github.io/muse-benchmark
License: http://creativecommons.org/licenses/by/4.0/
The gist: Large language models (LLMs) have recently advanced text-driven 3D generation, yet generating CAD models that satisfy practical design requirements remains challenging.
Terminology
Abstract
Large language models (LLMs) have recently advanced text-driven 3D generation, yet generating CAD models that satisfy practical design requirements remains challenging. Existing benchmarks focus primarily on single-part CAD models and geometric similarity, providing limited assessment of assembly structure and interface geometry. To address this gap, we introduce MUSE, a Text-to-CAD benchmark for generating multi-component, editable boundary representation (B-Rep) assemblies. MUSE pairs practical design instances with structured Design Specifications and evaluates generated outputs across four dimensions: code executability, geometric validity, structural and interface fidelity, and functional consistency. We further introduce Structure and Interface Evaluation (SIE), which combines reference Physical Assembly Graphs with direct B-Rep analysis to assess component correspondence, connectivity, interface types, and interface clearances. Experiments on proprietary and open-weight LLMs show that high execution success does not necessarily translate into correct assembly structure or interface geometry. Together, MUSE provides a benchmark and evaluation framework for studying multi-component Text-to-CAD generation beyond shape similarity. Our project website, including the leaderboard, dataset, and code, is available at.
Sources
- TripoSR: Fast 3D Object Reconstruction from a Single Image
- ArtiCAD: Articulated CAD Assembly Design via Multi-Agent Code Generation
- MLLM-Bench: Evaluating Multimodal LLMs with Per-sample Criteria
- Human-Aligned MLLM Judges for Fine-Grained Image Editing Evaluation: A Benchmark, Framework, and Analysis
- A High-Quality Dataset and Reliable Evaluation for Interleaved Image-Text Generation
- GenArena: How Can We Achieve Human-Aligned Evaluation for Visual Generation Tasks?
- Advancing Multimodal Judge Models through a Capability-Oriented Benchmark and MCTS-Driven Data Generation
- Multi-Crit: Benchmarking Multimodal Judges on Pluralistic Criteria-Following
- CADSmith: Multi-Agent CAD Generation with Programmatic Geometric Validation
- Text-to-CAD Generation Through Infusing Visual Feedback in Large Language Models
- Generating CAD Code with Vision-Language Models for 3D Designs
- Pointer-CAD: Unifying B-Rep and Command Sequences via Pointer-based Edges & Faces Selection
- CAD-MLLM: Unifying Multimodality-Conditioned CAD Generation With MLLM
- Text2CAD: Text to 3D CAD Generation via Technical Drawings
Related papers
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Agents' Last Exam
- The Clinician's Veto: Navigating Trust, Liability, and Uncertainty in Autonomous AI Prescribing
- MindHelper: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention
- Incumbent Advantage: Brand Bias and Cognitive Manipulation Dynamics in LLM Recommendation Systems