Reinforced Planning with Latent World Models
Reinforced Planning with Latent World Models (RP1) is a model-based planner that learns how to improve multi-step plans. It uses an actor-critic architecture where a critic evaluates imagined outcomes and an actor optimizes the plan. RP1 learns an update rule for planning, significantly outperforming traditional search algorithms while requiring vastly fewer world-model rollouts.