Evolutionary System Prompt Learning for Reinforcement Learning in LLMs
cs.AI, cs.LG
Submitted: 2026-02-16
Updated: 2026-11-07
Code: https://github.com/LunjunZhang/E-SPL
Terminology
Sources
- GPT-4 Technical Report
- gpt-oss-120b & gpt-oss-20b Model Card
- GEPA: Reflective Prompt Evolution Can Outperform Reinforcement Learning
- Recontextualization Mitigates Specification Gaming without Modifying the Specification
- Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback
- Constitutional AI: Harmlessness from AI Feedback
- Measuring Progress on Scalable Oversight for Large Language Models
- Training-Free Group Relative Policy Optimization
- MiniMax-M1: Scaling Test-Time Compute Efficiently with Lightning Attention
- Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilities
- DeepSeek-V3 Technical Report
- Promptbreeder: Self-Referential Self-Improvement Via Prompt Evolution
- Scaling and evaluating sparse autoencoders
- Accelerating scientific discovery with Co-Scientist
- DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning
- EvoPrompt: Connecting LLMs with Evolutionary Algorithms Yields Powerful Prompt Optimizers
- Population Based Training of Neural Networks
- OpenAI o1 System Card
- Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learning
- Scaling sparse feature circuit finding for in-context learning
Related papers
- Multi-Objective Structured Pruning of LLMs for Latency and Model Size Optimization
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Embeddings for Preferences, Not Semantics
- Can We Trust Item Response Theory for AI Evaluation?
- Diagnosing Task Insensitivity in Language Agents