Cross-Modal Attention Guided Unlearning in Vision-Language Models

summary

The gist

Vision-Language Models (VLMs) have demonstrated immense capabilities in multi-modal understanding and inference tasks such as Visual Question Answering (VQA)…

In short

CAGUL is a lightweight framework for unlearning private data from Vision-Language Models using cross-modal attention. It uses a discriminator and an encoder to identify and encode unlearning information into visual tokens with low cross-modal attention scores, effectively forgetting sensitive queries while preserving the model's general knowledge.

Key concepts

Cross-Modal Attention Scores
These are the numerical scores calculated between visual input tokens (images) and text input tokens (queries). They measure how closely related a specific part of an image is to a specific word in the prompt. The method uses these scores to decide which visual information is most important for unlearning.
Discriminator Module
This module acts as a classifier that determines whether a given visual input is associated with a query about private data or not. It helps the framework identify which images need to be targeted for the unlearning process, guiding the subsequent token selection.
Visual Token Encoder (Fψ)
This component takes visual tokens deemed important for unlearning and linearly transforms them. By focusing on tokens with low cross-modal attention scores, this encoder embeds the specific information needed to forget data without significantly disrupting the model's overall behavior.

Terminology used across episodes

This episode discusses

The paper

Cross-Modal Attention Guided Unlearning in Vision-Language Models · Read on arXiv

Karuna Bhaila, Aneesh Komanduri, Minh-Hao Van, Xintao Wu

University of Arkansas

Vision-Language Models (VLMs) have demonstrated remarkable capabilities in multi-modal understanding for tasks such as Visual Question Answering (VQA), which requires models to infer outputs based on visual and textual context simultaneously. However, models may memorize some private and/or sensitive information during training and regurgitate it in inference. Recently, machine unlearning has been leveraged to address such leakage of private data in LLMs. VLMs add a layer of complexity to this process, as the visual context in the query may additionally contain sensitive information. To address this issue, we explore unlearning for VLMs, specifically for the VQA task. We explore the role of visual tokens for output generation in VLMs using cross-modal attention and utilize it to formulate Cross-Modal Attention Guided Unlearning (CAGUL), a lightweight and efficient VLM unlearning framework. In contrast to computationally expensive finetuning methods, CAGUL utilizes external modules to encode unlearning information in visual tokens of low importance for relevant queries. Empirical results show that the transformed visual tokens prevent leakage and retain reference model behavior to achieve desirable trade-offs in forget quality and model utility without altering pretrained model parameters.

Transcript

Introduction to the show: ident: AI Radio. Generated commentary on the latest Artificial Intelligence papers.

Tom: I'm Tom.

Jane: And I'm Jane, here with Lu, Meng and our in-house large language model, Lalam.

Tom: We're looking at the paper: "Cross-Modal Attention Guided Unlearning in Vision-Language Models".

Paper summary: Tom: So we're looking at this paper called "Cross-Modal Attention Guided Unlearning in Vision-Language Models." It looks like they're tackling the problem of forgetting private data from these big vision and language models, specifically for visual question answering tasks.

Jane: Right, so the core idea here seems to be that instead of retraining the whole massive model, they want a way to selectively forget certain information linked to specific queries by looking at how the visual and text parts interact during processing.

Lu: Exactly. They're proposing this framework called CAGUL, which uses cross-modal attention scores between the visual and text inputs to guide where they encode the unlearning information in the visual tokens that are least important for a particular query.

Meng: Wait, so how does it actually work? I mean, if we don't retrain the main model parameters, what are we actually modifying? Does this just change the input embeddings before they go to the language model?

Tom: It’s not just changing the input. They have these external modules that are trained separately. There's a discriminator module that checks if an image is paired with a private query, and then there's this visual token encoder that transforms the visual tokens based on those attention scores.

Jane: So, to put it plainly, they use the attention map between the picture and the question to decide which parts of the picture are least relevant when you want to forget something. They conjecture that information in those least attended tokens is useful for unlearning private or non-private queries.

Lu: That's what they're doing. They’re using this idea from how VLMs extract details, where they compress visual info into a small set of highly attended tokens, and applying the opposite logic—focusing on the least attended ones for forgetting.

Meng: Okay, so it’s a selection process based on attention scores leading to an encoding step. But what about training? How do we train these external modules without messing up the billions of parameters in the VLM itself?

Tom: They train two main things: the discriminator module and this visual token encoder. The discriminator is trained with a classification objective, and the encoder is trained using specific loss objectives for both forgetting and retaining data separately.

Jane: For forgetting, they use something called Preference Optimization to align the language model's outputs for forget queries with refusal responses instead of the actual correct answer. That’s a clever way to signal what we want to erase.

Lu: And for retaining data, they have an objective that tries to maintain the base model’s predictive utility, which is important because they don't just want to erase everything; they want to keep general knowledge intact.

Meng: I see the trade-off there. So you're trying to find this sweet spot where you forget the private data without destroying the model’s ability to answer normal questions correctly? That sounds like it could be a big deal for production systems.

Paper summary: Tom: Experimental results show that CAGUL performs better than finetuning baselines on forgetting quality and even keeps the retain utility of the finetuned base model. And what's cool is they don't alter any of the pre-trained VLM parameters or incur retraining costs.

Jane: That’s significant because it means you can exercise that right to be forgotten for specific subsets of data without having to spend a lot of time and compute on full finetuning. And they kept the computational efficiency quite high, training far fewer parameters than other methods.

Lu: The ablation study shows that while CAGUL can get good trade-offs between forgetting and retaining metrics without the discriminator, its generalization ability suffers if you remove it. But without this encoder module, forget and retain performance drops significantly.

Meng: So it seems the discriminator is crucial for knowing *when* to apply the token selection mechanism, and the encoder is necessary to actually embed that unlearning signal into those selected tokens. That’s a lot of moving parts to get right at scale.

Tom: This whole CAGUL framework is essentially a way for individual users to exercise the right to be forgotten on subsets of their sensitive queries within these vision-language models. It’s a novel setting for machine unlearning in this domain.

Jane: So, the paper "Cross-Modal Attention Guided Unlearning in Vision-Language Models" proposes using cross-modal attention to guide the encoding of unlearning information into low-importance visual tokens for relevant queries.

Lu: That's the main mechanism they are investigating, focusing on how those attention scores between vision and text dictate which visual tokens get modified for forgetting.

Meng: It’s interesting because it leverages existing attention mechanisms instead of completely rebuilding the model training loop or fine-tuning every layer we have to touch. That makes deployment much more practical.

Tom: The authors show this method works on the FIUBench dataset, using two different open-source vision-language models, and they show it achieves good trade-offs compared to finetuning methods without altering the pre-trained model parameters or retraining costs.

Jane: So what this means for us is that we can potentially make these powerful multimodal models more private and compliant with privacy regulations by using targeted unlearning instead of broad fine-tuning.

Lu: It shifts the focus from massive parameter updates to targeted modifications guided by attention patterns, which is a different direction in how we think about model modification.

Meng: If this scales well on real traffic, it could be a huge win for deploying these models where data privacy is a major concern, because the cost of unlearning seems much lower.

Tom: The conclusion of this work is that CAGUL provides an effective way to handle machine unlearning in vision-language models by using a classifier to identify images from the forget set, an attention-based selection mechanism, and an encoder for embedding information into low-attention visual tokens.

Jane: Essentially, they’ve found a novel setting where users can forget specific subsets of attributes available to the model by leveraging cross-modal attention. It’s a practical approach to privacy in multimodal AI.

Conclusion: Tom: So, we're wrapping up on "Cross-Modal Attention Guided Unlearning in Vision-Language Models." Basically, they showed how you can selectively forget data from these big vision and language models without having to retrain the whole thing from scratch.

Jane: Right, so the title is Cross-Modal Attention Guided Unlearning in Vision-Language Models. It’s about using that attention score between the picture and the text to guide where they put information when you want to forget something.

Lu: They use a discriminator module and a visual token encoder to do this selective forgetting based on how important those tokens are for the specific query you’re asking about.

Meng: I just want to know what this means in practice, Tom. If someone wants to forget their private data, does this mean we can just point at the picture and type the query? Or is there a more complex setup?

Tom: It's more complex than that. You need that discriminator module to first figure out if the image is actually paired with a private query before you even look at those attention scores for token selection.

Jane: And they showed it works on two different vision and language models, meaning this approach isn't tied to just one specific model architecture.

Lu: The key result is that this method achieves a good balance between forgetting the data and keeping the model smart enough to answer regular questions, which is what we call retain utility.

Meng: That balance sounds important because usually when you try to erase something, you either lose too much general knowledge or you forget too much of what's actually private.

Tom: Exactly. They found a sweet spot where it performs better than traditional finetuning methods on the forgetting side while preserving that retained utility.

Jane: So the implication is that for anyone dealing with sensitive data, this offers a new way to exercise the right to be forgotten on specific parts of what a multimodal AI knows.

Lu: It’s about moving away from massive parameter updates toward targeted modifications guided by how the model processes information cross-modally.

Meng: That makes sense for deployment because it doesn't require retraining the entire pre-trained model, which saves a ton of computational power and time at scale.

Tom: It’s definitely more efficient than those full finetuning baselines they compared it against, especially when you look at the training costs.

Jane: And this sets up a lot of interesting work for future research on how to make these models more private without sacrificing their overall usefulness for general tasks.

More episodes

← Home