AblationBench: Evaluating Automated Planning of Ablations in Empirical AI Research
cs.CL, cs.AI
Submitted: 2025-07-09
Updated: 2026-11-06
Code: https://github.com/google-research/arxiv-latex-cleaner
Terminology
Sources
- Can LLMs Replace Manual Annotation of Software Engineering Artifacts?
- What Does It Take to Be a Good AI Research Agent? Studying the Role of Ideation Diversity
- HalluLens: LLM Hallucination Benchmark
- Language Models are Few-Shot Learners
- Early science acceleration experiments with GPT-5
- ChatEval: Towards Better LLM-based Evaluators through Multi-Agent Debate
- MLE-bench: Evaluating Machine Learning Agents on Machine Learning Engineering
- A Generalization of Transformer Networks to Graphs
- Accelerating scientific discovery with Co-Scientist
- Kolb-Based Experiential Learning for Generalist Agents with Human-Level Kaggle Data Science Performance
- BLADE: Benchmarking Language Model Agents for Data-Driven Science
- GPT-GNN: Generative Pre-Training of Graph Neural Networks
- MLAgentBench: Evaluating Language Agents on Machine Learning Experimentation
- Understanding the planning of LLM agents: A survey
- Autonomous LLM-driven research from data to human-verifiable research papers
- AutoKaggle: A Multi-Agent Framework for Autonomous Data Science Competitions
- Neural-Pull: Learning Signed Distance Functions from Point Clouds by Learning to Pull Space onto Surfaces
- Self-Composing Policies for Scalable Continual Reinforcement Learning
- Ablation Studies in Artificial Neural Networks
- MLGym: A New Framework and Benchmark for Advancing AI Research Agents
Related papers
- ALARM: Audio-Language Alignment for Reasoning Models
- From Facts to Insights: A Persona-Driven Dual Memory Framework and Dataset for Role-Playing Agents
- Improving General Role-Playing Agents via Psychology-Grounded Reasoning and Role-Aware Policy Optimization
- The Art of Asking: Multilingual Prompt Optimization for Synthetic Data
- BALTO: Balanced Token-Level Policy Optimization for Hallucination Mitigation
- Hidden Measurement Error in LLM Pipelines Distorts Annotation, Evaluation, and Benchmarking