Detect, Explain, Interpret: An End-to-End Benchmark for Time Series Anomaly Detection, Explainability and Interpretability
cs.LG, cs.AI, cs.DB
Submitted: 2026-10-01
Updated: 2026-10-01
Code: https://github.com/scality/shad
License: http://creativecommons.org/licenses/by/4.0/
The gist: Time Series Anomaly Detection has received increasing attention, driven by the growing availability of complex time series data.
Terminology
Abstract
Time Series Anomaly Detection has received increasing attention, driven by the growing availability of complex time series data. This surge has led to the development of numerous detection methods, as well as a variety of benchmarks aimed at thoroughly evaluating their performance. However, most existing detectors remain largely agnostic to domain context, overlooking explainability and interpretability. One of the main reasons for this gap is that current benchmarks primarily focus on detection accuracy, and only few of them evaluate spatial explainability. Moreover, no benchmark currently provides sufficiently rich semantic annotations to support the generation of human-understandable interpretations of anomalies. To address these limitations, we introduce SHAD (Scality High-dimensional Anomaly Detection benchmark), a fully annotated benchmark composed of 215 multivariate, high-dimensional time series collected from real-world distributed cloud storage systems operated by Scality. The proposed dataset includes rich contextual information, covering three families of anomalies with varying degrees of severity. As further contribution, we provide a foundation for future work by evaluating baseline methods for Detection, Explainability, and Interpretability, covering all stages of a TSAD pipeline. For Detection, we benchmark a wide range of existing anomaly detectors, testing their effectiveness on the proposed real-world dataset. Then, we consider explainability by evaluating whether measuring the contribution of each dimension in the generated anomaly score can provide accurate anomaly attributions. Finally, for interpretability, we investigate the effectiveness of frozen LLM baselines in localizing and interpreting anomalies.
Sources
- Dive into Time-Series Anomaly Detection: A Decade Review
- VUS: Effective and Efficient Accuracy Measures for Time-Series Anomaly Detection
- Multivariate Industrial Time Series with Cyber-Attack Simulation: Fault Detection Using an LSTM-based Predictive Data Model
- Distilling a Neural Network Into a Soft Decision Tree
- Exathlon: A Benchmark for Explainable Anomaly Detection over Time Series
- Time-LLM: Time Series Forecasting by Reprogramming Large Language Models
- Text2TimeSeries: Enhancing Financial Forecasting through Time Series Prediction Updates with Event-Driven Insights from Large Language Models
- Matrix Profile Goes MAD: Variable-Length Motif And Discord Discovery in Data Series
- catch22: CAnonical Time-series CHaracteristics
- Robust PCA for Anomaly Detection in Cyber Networks
- TAB: Unified Benchmarking of Time Series Anomaly Detection Methods
- Lag-Llama: Towards Foundation Models for Probabilistic Time Series Forecasting
- TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysis
- ChatTS: Aligning Time Series with LLMs via Synthetic Data for Enhanced Understanding and Reasoning
- Anomaly Transformer: Time Series Anomaly Detection with Association Discrepancy
- FITS: Modeling Time Series with $10k$ Parameters
- Stress-Testing Model Specs Reveals Character Differences among Language Models
- D-Bot: Database Diagnosis System using Large Language Models
- See it, Think it, Sorted: Large Multimodal Models are Few-shot Time Series Anomaly Analyzers
Related papers
- Polynomial-Augmented Neural Networks (PANNs) with Weak Orthogonality Constraints for Enhanced Function and PDE Approximation
- AIRL-S: Unifying Reinforcement Learning and Search-Based Test-Time Scaling via Adversarial Inverse Reinforcement Learning
- Transformers as Bayesian In-Context Experimenters: Smoothness-Adaptive Efficient ATE Estimation
- Convergence issues in Relational Concept Analysis based on AOC-posets
- Beliefs Beyond Posteriors: The Predictive Cost of ELBO Binding
- Understanding Diffusion Models via Ratio-Based Function Approximation with SignReLU Networks