FATE: Fault-Aware Transfer Error for Unsupervised Anomaly Detection
cs.CV
Submitted: 2026-11-05
Updated: 2026-11-08
Comments: 22 pages including appendix; 4 figures and 21 tables. Preprint
License: http://creativecommons.org/licenses/by/4.0/
The gist: We study unsupervised industrial anomaly detection in the single-class setting, where a detector learns only from normal images of one product category.
Terminology
Abstract
We study unsupervised industrial anomaly detection in the single-class setting, where a detector learns only from normal images of one product category. Reconstruction-based detectors model normal features from a frozen encoder, but their target layers are usually chosen by architectural convention. We instead ask what information one block can pass to another. Treating depth as a sequence of discrete transitions, we train eight directed, token-wise predictors from block 1 and blocks 21-23 to blocks 7 and 14. Adjacent-layer cosine similarity drops at four repeatable fault lines in DINOv2 ViT-L, separating stable depth segments. The deepest blocks retain semantic context but lose local detail, so the residual of a source-to-sensitive prediction measures information that cannot be transported. The fault structure constrains the source and target roles, and the same rule transfers to ViT-B and RADIO-B. A bounded foreground prior, calibrated only on normal training images, suppresses background residuals while retaining a positive floor for evidence outside the estimated foreground. With the same eight channels and a common training-only calibration procedure in every single-category model, category-averaged image AUROC reaches 99.75 on MVTec-AD, 99.42 on VisA and 94.27 on Real-IAD; object-level AUROC on Real-IAD is 96.26. For the 448x448 runs, category-averaged P-AUROC/P-AUPRO on a common 256x256 evaluation grid is 98.46/95.97 on MVTec-AD, 99.21/96.12 on VisA and 99.26/96.59 on Real-IAD.
Sources
- Dynamic Mode Decomposition along Depth in Vision Transformers
- Learning to Be a Transformer to Pinpoint Anomalies
- Dinomaly2: A Unified Framework for Unsupervised Image Anomaly Detection
- Block-Recurrent Dynamics in Vision Transformers
- Mechanisms of Non-Monotonic Scaling in Vision Transformers
- A concise introduction to Koopman operator theory and the Extended Dynamic Mode Decomposition
Related papers
- TEA: Text Encoder Alignment for Robust Concept Erasure in Text-to-Image Models
- Do Egocentric Video-Language Models Capture Both Hand- and Object-Centric Cues?
- Aura: Consistent Multi-Subject Video Generation via VLM-Grounded Semantic Alignment
- PVRF: All-in-one Adverse Weather Removal via Prior-modulated and Velocity-constrained Rectified Flow
- DLWM: Diverse Latent World Models for Efficient Multimodal Reasoning
- Out of Sight, Still in Mind: Token Compression for Omni-LLMs