Learning from the Right Rollouts: Data Attribution for PPO-based LLM Post-Training
The episode discusses a paper titled "Learning from the Right Rollouts: Data Attribution for PPO-based LLM Post-Training." The hosts discuss how this method shifts training toward data curation by quantifying which training rollouts contribute most to performance gains. They conclude that this technique helps rank historical data based on genuine impact, improving model reliability and efficiency.