Multi-Task Consistency-based Detection of Adversarial Attacks

arXiv:2608.07750 · cs.CV, cs.AI · Submitted 2026-08-07 · Read on arXiv

Cong Chen, Jean-Philippe Monteuuis, Jonathan Petit

cs.CV, cs.AI

Submitted: 2026-08-07

Updated: 2026-08-11

Code: https://github.com/SysCV/bdd100k-models

License: http://creativecommons.org/licenses/by/4.0/

The gist: Deep Neural Networks (DNNs) have found successful deployment in numerous vision perception systems.

Terminology

Abstract

Deep Neural Networks (DNNs) have found successful deployment in numerous vision perception systems. However, their susceptibility to adversarial attacks has prompted concerns regarding their practical applications, specifically in the context of autonomous driving. Existing defenses often suffer from cost inefficiency, rendering their deployment impractical for resource-constrained applications. In this work, we propose an efficient and effective adversarial attack detection scheme leveraging the multi-task perception within a complex vision system. Adversarial perturbations are detected by the inconsistencies between the inference outputs of multiple vision tasks, e.g., object detection and instance segmentation. To this end, we developed a consistency score metric to measure the inconsistency between vision tasks. Next, we designed an approach to select the best model pairs for detecting inconsistencies effectively. Finally, we evaluated our defense against PGD attacks across multiple vision models on the BDD100k validation dataset. The experimental results demonstrated that our defense achieved a ROC-AUC performance of 99.9% detection within the considered attacker model.

Sources

Related papers