RealEmbedBench: Benchmarking LLMs on Real-World Application-Layer Embedded Software Tasks
cs.AI, cs.SE
Submitted: 2026-11-08
Updated: 2026-11-08
Code: https://github.com/huangyujun1215/RealEmbedBench
Terminology
Sources
- BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions
- CoCo-Bench: A Comprehensive Code Benchmark For Multi-task Large Language Model Evaluation
- DeepSeek-V3.2: Pushing the Frontier of Open Large Language Models
- Qwen3 Technical Report
- CodeBLEU: a Method for Automatic Evaluation of Code Synthesis
Related papers
- Multi-Objective Structured Pruning of LLMs for Latency and Model Size Optimization
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Embeddings for Preferences, Not Semantics
- Can We Trust Item Response Theory for AI Evaluation?
- Diagnosing Task Insensitivity in Language Agents