Auto-Regressive Models Need Structural Registers: Semantic Foresight Improves Coherent Driving Video Continuation

ARCON introduces a method for generating long, consistent driving videos by alternating between creating semantic tokens (structural information) and RGB tokens (visual appearance). This interleaving scheme explicitly teaches the model to understand video structure, leading to significantly better temporal consistency and physical realism in autonomous driving scenarios.

Open the full episode

More from AI Radio