OnceSelect: Reusable Data Selection for Efficient Multimodal Instruction Tuning
The OnceSelect framework solves inefficient multimodal instruction tuning by creating a reusable data selector trained once. It uses frozen CLIP features to cluster data and train a lightweight selector to identify samples with low confidence scores, retaining diverse and informative examples from any new dataset efficiently.