Structure-Aware Numerical Stabilization for Half-Precision Proximal Policy Optimization
PPO-FP16 proposes a structure-aware design to stabilize training when using half-precision (FP16) for Proximal Policy Optimization. It stabilizes training by selectively protecting shared statistics, small policy changes, and persistent parameter updates through three distinct modules. This approach achieves stable FP16 PPO without requiring retraining.