OnceSelect: Reusable Data Selection for Efficient Multimodal Instruction Tuning

The OnceSelect framework solves inefficient multimodal instruction tuning by creating a reusable data selector trained once. It uses frozen CLIP features to cluster data and train a lightweight selector to identify samples with low confidence scores, retaining diverse and informative examples from any new dataset efficiently.

Open the full episode

More from AI Radio