Fast Preemptive Robustification: High-Frequency Response Anti-Aligns Shared Vulnerability
cs.CV
Submitted: 2026-03-26
Updated: 2026-09-17
Code: https://github.com/anlthms/nips-2017
License: http://creativecommons.org/licenses/by/4.0/
The gist: Adversarial attacks can readily compromise deep neural networks (DNNs).
Terminology
Abstract
Adversarial attacks can readily compromise deep neural networks (DNNs). In particular, transferable attacks (TAs) exploit the shared vulnerabilities among DNNs, enabling perturbations crafted on surrogates to transfer to unseen models. Training-time and post-attack defenses have been extensively studied for combating TAs. Orthogonal to these approaches, preemptive robustification (PR) has emerged as a pre-attack defense that enhances the robustness of benign samples by superimposing protective variations before attacks. Despite its promise, PR remains underexplored and faces several important limitations. First, dependence on well-trained surrogate classifiers limits applicability, as surrogates are task-specific and may even be unavailable in some practical settings. Second, the required iterative optimization or dedicated PR generator training incurs substantial costs. Third, the generated variations are opaque to humans. To address these, we seek an efficient PR that is surrogate-free, optimization-free, training-free, and human-interpretable. Intriguingly, we discover a numerical correlation between the shared vulnerabilities of DNNs and Laplacian responses, with their cosine similarity being significantly negative. This indicates that negated high-frequency response constitutes an important component of shared vulnerabilities. Consequently, strengthening Laplacian responses counteracts this component, improving resistance to TAs. Building upon this insight, we propose Fast Preemptive Robustification (FPR), which performs Laplacian sharpening via a single channel-wise convolution with a 3 times3 kernel. FPR is simple yet effective, as demonstrated by extensive experiments. Specifically, FPR reduces the attack success rate (ASR) of untargeted TAs by 12.7% and that of targeted TAs from 10.7% to 4.1%. Code will be released publicly.
Sources
- MeanSparse: Post-Training Robustness Enhancement Through Mean-Centered Feature Sparsification
- Local Convolutions Cause an Implicit Bias towards High Frequency Adversarial Examples
- Rethinking Model Ensemble in Transfer-based Adversarial Attacks
- Reducing Texture Bias of Deep Neural Networks via Edge Enhancing Diffusion
- OTI: A Model-free and Visually Interpretable Measure of Image Attackability
- Robust Principles: Architectural Design Principles for Adversarially Robust CNNs
- Intriguing properties of neural networks
Related papers
- Loss Knows Best: Detecting Annotation Errors in Videos via Loss Trajectories
- AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memories
- Benchmarking the Robustness of Foundation Models for Mammography under Domain Shift
- MambaX-Net: Dual-Input Mamba-Enhanced Cross-Attention Network for Longitudinal MRI Segmentation
- TeleOCR: Navigating Document Parsing Across Digital and Camera-Captured Documents
- A Survey on Efficient Vision-Language-Action Models