Rethinking Fine-Tuning: Unlocking Hidden Capabilities in Vision-Language Models
Mask Fine-Tuning (MFT) is a method to adapt Vision-Language Models without changing frozen weights. It introduces learnable masks that reorganize internal sub-networks for task adaptation, outperforming traditional methods like LoRA and full fine-tuning by reestablishing existing knowledge.