Localize and Neutralize: Gradient-guided Token Suppression against Visual Prompt Injection Attack
The episode discusses 'Localize and Neutralize,' a defense against visual prompt injection attacks. This method identifies specific, critical tokens within an image embedding sequence using gradient-guided techniques. It then masks these high-influence tokens during inference, stopping the attack instantly while maintaining the model's normal functionality.