AdvantageFlow: Regularized Advantage-Weighted RL in Flow Models
The episode discusses AdvantageFlow, a forward-process reinforcement learning algorithm for rectified flow models. It focuses on optimizing a forward-process prediction loss weighted by sample advantages to guide generation toward rewarding outputs. The method uses rollout and reference policy regularization for stability and achieves superior performance over methods like Flow-GRPO.