Velox: Spatial Memory Makes World Models Efficient
Video world models struggle with managing visual memory during long rollouts, causing slow performance due to growing context caches. Velox introduces a training-free attention router that uses camera frustum slabs from streaming geometry to intelligently select relevant historical context. This method modulates model importance based on region coverage, significantly accelerating generation speed without increasing the KV cache size.