Higher-Order Action Supervision Makes A Strong Policy Class
The research introduces a new loss scheme that simultaneously supervises both zeroth-order (action) and first-order action dynamics for various policy models. This method enhances policy performance and robustness by ensuring temporal consistency in actions, which is critical for stable control in real-world applications like robotics. The scheme works without modifying the existing policy structure.