Skip-patching spatial-temporal discrepancy-based anomaly detection on multivariate time series

Yinsong XU, Yulong DING, Jie JIANG, Runmin CONG, Xuefeng ZHANG, Shiqi WANG, Sam KWONG, Shuang-Hua YANG

Research output: Journal PublicationsJournal Article (refereed)peer-review

Abstract

Anomaly detection in the Industrial Internet of Things (IIoT) is a challenging task that relies heavily on the efficient learning of multivariate time series representations. We introduce Skip-patching and Spatial-Temporal discrepancy mechanisms to improve the efficiency of detecting anomalies. Traditional feature extraction is hindered by redundant information in limited datasets. The situation is that feature generation from stable operational processes results in low-quality representations. To address this challenge, we propose the Skip-Patching mechanism. This approach involves selectively extracting features from partial data patches, prompting the model to learn more meaningful knowledge through self-supervised learning. It also effectively doubles the training sample size by creating independent sub-groups of patches. Despite the complex spatial and temporal relationships in IIoT systems, existing methods mainly extracted features from a single domain, either temporal or spatial (sensor-wise), or simply cascaded two features, i.e., one after one, which limited anomaly detection capabilities. To address this, we introduce the Spatial-Temporal Association Discrepancy component, which leverages discrepancies between spatial and temporal features to enhance latent representation learning. Our Skip-Patching Spatial-Temporal Anomaly Detection (SSAD) framework combines these two components to provide a more diverse and comprehensive learning process. Tested across four multivariate time series anomaly detection benchmarks, SSAD demonstrates superior performance, confirming the efficacy of combining Skip-patching and Spatial-Temporal features to enhance anomaly detection in IIoT systems.
Original languageEnglish
Article number128428
JournalNeurocomputing
Volume609
Early online date20 Aug 2024
DOIs
Publication statusE-pub ahead of print - 20 Aug 2024

Bibliographical note

Publisher Copyright:
© 2024 The Author(s)

Keywords

  • Anomaly detection
  • Industrial Internet of Things
  • Self-supervised learning
  • Multivariate time series

Fingerprint

Dive into the research topics of 'Skip-patching spatial-temporal discrepancy-based anomaly detection on multivariate time series'. Together they form a unique fingerprint.

Cite this