Rethinking Fine-Tuning: Unlocking Hidden Capabilities in Vision-Language Models

Mask Fine-Tuning (MFT) is a method to adapt Vision-Language Models without changing frozen weights. It introduces learnable masks that reorganize internal sub-networks for task adaptation, outperforming traditional methods like LoRA and full fine-tuning by reestablishing existing knowledge.

Open the full episode

More from AI Radio