Singularity-Bench: Can Agents Build Agents?
cs.AI
Submitted: 2026-11-12
Updated: 2026-11-16
Code: https://github.com/radixark/miles
Project page: https://infini-ai-lab.github.io/singularity-bench
Terminology
Sources
- FlashRT: Agent Harness for Guiding Agents to Deploy Real-Time Multimodal Applications
- GEPA: Reflective Prompt Evolution Can Outperform Reinforcement Learning
- Vending-Bench: A Benchmark for Long-Term Coherence of Autonomous Agents
- Kevin: Multi-Turn RL for Generating CUDA Kernels
- MLE-bench: Evaluating Machine Learning Agents on Machine Learning Engineering
- SWE-CI: Evaluating Agent Capabilities in Maintaining Codebases via Continuous Integration
- Evaluating Large Language Models Trained on Code
- Let the Barbarians In: How AI Can Accelerate Systems Performance Research
- Barbarians at the Gate: How AI is Upending Systems Research
- Language Modeling by Language Models
- DeepSeek-V4.1-Flash: Pushing the Limits of KV Cache Compression
- LLMZero: Discovering Adaptive Training Strategies for RL Post-Training via LLM Agents
- GLM-5: from Vibe Coding to Agentic Engineering
- The Llama 3 Herd of Models
- Glia: A Human-Inspired AI for Automated Systems Design and Optimization
- MLAgentBench: Evaluating Language Agents on Machine Learning Experimentation
- DeepSWE: Measuring Frontier Coding Agents on Original, Long-Horizon Engineering Tasks
- LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code
- SWE-bench: Can Language Models Resolve Real-World GitHub Issues?
Related papers
- Multi-Objective Structured Pruning of LLMs for Latency and Model Size Optimization
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Embeddings for Preferences, Not Semantics
- Can We Trust Item Response Theory for AI Evaluation?
- Diagnosing Task Insensitivity in Language Agents