Zero-shot Video Moment Retrieval via Off-the-shelf Multimodal Large Language Models

Moment-GPT is a tuning-free method for zero-shot Video Moment Retrieval that uses frozen Multimodal Large Language Models (MLLMs). It improves performance by first using LLaMA-3 to correct language biases in search queries. Then, it adaptively generates candidate video spans and selects the best ones using video comprehension modules, achieving state-of-the-art results without any fine-tuning.

Open the full episode

More from AI Radio