Hint-Guided Diversified Policy Optimization for LLM Reasoning
Hint-Guided Diversified Policy Optimization (HDPO) enhances LLM reasoning by internalizing a 'propose-select-think' process into its policy parameters. It uses two stages: structured reasoning data collection and reinforcement learning guided by format, accuracy, diversity, and reliability rewards. This method improves solution diversity without sacrificing the reliability of the final answer.