Outcome-Mass Alignment: Controlling Length-Dependent Trajectory Influence in Multi-Turn LLM Agent Reinforcement Learning
cs.CL
Submitted: 2026-11-12
Updated: 2026-11-12
Terminology
Sources
- LMRL Gym: Benchmarks for Multi-Turn Reinforcement Learning with Language Models
- Back to Basics: Revisiting REINFORCE Style Optimization for Learning from Human Feedback in LLMs
- AsyncWebRL: Efficient Asynchronous Reinforcement Learning for Multi-Step Visual Web Agents
- Group-in-Group Policy Optimization for LLM Agent Training
- Hierarchy-of-Groups Policy Optimization for Long-Horizon Agentic Tasks
- VL Norm: Rethink Loss Aggregation in RLVR
- Stabilizing Off-Policy Training for Long-Horizon LLM Agent via Turn-Level Importance Sampling and Clipping-Triggered Normalization
- Understanding R1-Zero-Like Training: A Critical Perspective
- Agent Lightning: Train ANY AI Agents with Reinforcement Learning
- HiPER: Hierarchical Reinforcement Learning with Explicit Credit Assignment for Large Language Model Agents
- A Survey of Temporal Credit Assignment in Deep Reinforcement Learning
- WebRL: Training LLM Web Agents via Self-Evolving Online Curriculum Reinforcement Learning
- Qwen2.5 Technical Report
- Proximal Policy Optimization Algorithms
- DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models
- Hindsight Credit Assignment for Long-Horizon LLM Agents
- CAPO: Critic-Guided Action-Aligned Policy Optimization for Advancing LLM Agent Capabilities
- A Practitioner's Guide to Multi-turn Agentic Reinforcement Learning
- $\lambda$-GRPO: Unifying the GRPO Frameworks with Learnable Token Preferences
- RAGEN: Understanding Self-Evolution in LLM Agents via Multi-Turn Reinforcement Learning
Related papers
- ALARM: Audio-Language Alignment for Reasoning Models
- ThinkSum: Probabilistic reasoning over sets using large language models
- Coherence boosting: When your pretrained language model is not paying enough attention
- From Facts to Insights: A Persona-Driven Dual Memory Framework and Dataset for Role-Playing Agents
- Improving General Role-Playing Agents via Psychology-Grounded Reasoning and Role-Aware Policy Optimization
- The Art of Asking: Multilingual Prompt Optimization for Synthetic Data