Drift, Then Spread: Learning One-Step Generative Policies for Online Reinforcement Learning
DRIFTSPREAD proposes a one-step generative policy for online reinforcement learning by combining critic-guided Drift and entropy-induced Spread updates derived from a Maximum Entropy objective. This method achieves superior performance over diffusion and flow baselines on MuJoCo, offering higher return and lower training costs while maintaining fast inference.