Can Video World Models Track Unobserved World States?
The study tested if video world models can track hidden states across sequences of actions, using a 'Shell Game' as a test for state tracking. Standard models failed to maintain the hidden state when swaps exceeded a small depth. The findings suggest current architectures need recurrent transitions or history-dependent updates to robustly compose unobserved states.