Evaluating AI Agents for Industrial-Level Chip Floorplanning: A Framework and Empirical Study
cs.AI
Submitted: 2026-11-09
Updated: 2026-11-12
Code: https://github.com/MIRALab-USTC/ChiPBench
License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
Terminology
Sources
- Deep Reinforcement Learning at the Edge of the Statistical Precipice
- Long-Horizon Analog Design Bench: Benchmarking Agents on Hours-Long Analog and Mixed-Signal Circuit Design Tasks
- Chip-Chat: Challenges and Opportunities in Conversational Hardware Design
- MLE-bench: Evaluating Machine Learning Agents on Machine Learning Engineering
- DG-RePlAce: A Dataflow-Driven GPU-Accelerated Analytical Global Placement Framework for Machine Learning Accelerators
- Hier-RTLMP: A Hierarchical Automatic Macro Placer for Large-scale Complex IP Blocks
- AI Agents That Matter
- PDAGENT-BENCH: Characterizing, Grounding, and Architecting LLM/VLM Agents for VLSI Physical Design
- PlaceReasoner-Beta: Reasoning-Driven Macro Placement and Benchmarking
- Terminal-Bench: Benchmarking Agents on Hard, Realistic Tasks in Command Line Interfaces
- Benchmarking End-To-End Performance of AI-Based Chip Placement Algorithms
Related papers
- Multi-Objective Structured Pruning of LLMs for Latency and Model Size Optimization
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Embeddings for Preferences, Not Semantics
- Can We Trust Item Response Theory for AI Evaluation?
- Diagnosing Task Insensitivity in Language Agents