ResBench: Benchmarking LLM-Generated FPGA Designs with Resource Awareness
cs.AR, cs.AI, cs.CL, cs.ET, cs.LG
Submitted: 2025-03-11
Updated: 2026-11-16
Code: https://github.com/jultrishyyy/ResBench
Terminology
Sources
- MetRex: A Benchmark for Verilog Code Metric Reasoning Using LLMs
- GPT-4 Technical Report
- Qwen Technical Report
- Evaluating Large Language Models Trained on Code
- BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
- InCoder: A Generative Model for Code Infilling and Synthesis
- AutoVCoder: A Systematic Framework for Automated Verilog Code Generation using LLMs
- Measuring Mathematical Problem Solving With the MATH Dataset
- Qwen2.5-Coder Technical Report
- GPT-4o System Card
- OpenAI o1 System Card
- Mistral 7B
- A Survey on Large Language Models for Code Generation
- StarCoder: may the source be with you!
- OctoPack: Instruction Tuning Code Large Language Models
- A Multi-Expert Large Language Model Architecture for Verilog Code Generation
- CodeGen: An Open Large Language Model for Code with Multi-Turn Program Synthesis
- CodeBLEU: a Method for Automatic Evaluation of Code Synthesis
- Code Llama: Open Foundation Models for Code
- LLaMA: Open and Efficient Foundation Language Models
Related papers
- Embedded Arena: Iterative Optimization via Hardware Feedback
- WitCert: Sound Runtime Risk Observability and Gating for KV-Cache Quantization
- SparsePixels: Efficient Convolution for Sparse Data on FPGAs
- Golden Ruler: A Numeric Format Catalog with Bit-Exact Conformance Vectors for FP8, BF16, MXFP4, and Microscaling Formats
- AMMA: A Multi-Chiplet Memory-Centric Architecture for Low-Latency 1M Context Attention Serving
- RFChipAgent: Multi-Agentic AI Flow for Analog/RF Chip Design