GenState-AI: State-Aware Dataset for Text-to-Video Retrieval on AI-Generated Videos

GenState-AI is a new benchmark for text-to-video retrieval created using AI to test if models understand state changes, not just static appearance. It uses 956 AI videos and specific queries paired with temporal and semantic hard negatives. Results show current models struggle to verify the final outcome, proving they lack fine-grained temporal grounding.

Open the full episode

More from AI Radio