SelfImprove-Bench: Evaluating Generalization in Self-Improving Agents
cs.AI, cs.CL, cs.LG, cs.MA
Submitted: 2026-11-02
Updated: 2026-11-02
Code: https://github.com/theseus-labs-rsi/SelfImprove-Bench
Terminology
Sources
- Hyperagents
- Agentic Context Engineering: Evolving Contexts for Self-Improving Language Models
- Agentic Harness Engineering: Observability-Driven Automatic Evolution of Coding-Agent Harnesses
- SEAGym: An Evaluation Environment for Self-Evolving LLM Agents
- Evo-Bench: Can Language Models Improve Agent Harness?
- FinEvo-Bench: A Longitudinal Benchmark for Self-Evolving Agents in Professional Financial Workflows
- PAST-Bench: Benchmarking the Foundations of Recursive Self-Improvement in Personal Agents
- EvoAgentBench: Benchmarking Agent Self-Evolution via Ability Transfer
- SkillLearnBench: Benchmarking Continual Learning Methods for Agent Skill Generation on Real-World Tasks
- LifelongAgentBench: Evaluating LLM Agents as Lifelong Learners
- Beyond Endpoint Performance: Process-Level Evaluation of Self-Evolving Agents
- ServeLearnBench: How Well Can Agents Self-Improve from Serving Experience?
- Self-Taught Optimizer (STOP): Recursively Self-Improving Code Generation
- RRSI: Regularized Recursive Self-Improvement of Agent Harnesses
- RSIBench-Data: Benchmarking Data-Centric Research for Recursive Self-Improvement
- Reflexion: Language Agents with Verbal Reinforcement Learning
- A-MEM: Agentic Memory for LLM Agents
- A Self-Improving Coding Agent
- Self-Harness: Harnesses That Improve Themselves
Related papers
- Multi-Objective Structured Pruning of LLMs for Latency and Model Size Optimization
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Embeddings for Preferences, Not Semantics
- Can We Trust Item Response Theory for AI Evaluation?
- Diagnosing Task Insensitivity in Language Agents