LEAF: Growing Trees Without Branching for Speech-Aware Large Language Model Post-Training
LEAF addresses coarse credit assignment in speech-aware LLM post-training by using a retrospective tree-based reinforcement learning method. It recovers structural information from training rollout batches to assign localized, piecewise constant advantages over token spans instead of treating every token equally. This improves model performance and tail risk behavior.