A Comprehensive Survey of Deep Transfer Learning for Anomaly Detection in Industrial Time Series: Methods, Applications, and Directions

07/11/2023
by   Peng Yan, et al.
0

Automating the monitoring of industrial processes has the potential to enhance efficiency and optimize quality by promptly detecting abnormal events and thus facilitating timely interventions. Deep learning, with its capacity to discern non-trivial patterns within large datasets, plays a pivotal role in this process. Standard deep learning methods are suitable to solve a specific task given a specific type of data. During training, the algorithms demand large volumes of labeled training data. However, due to the dynamic nature of processes and the environment, it is impractical to acquire the needed data for standard deep learning training for every slightly different case anew. Deep transfer learning offers a solution to this problem. By leveraging knowledge from related tasks and accounting for variations in data distributions, this learning framework solves new tasks even with little or no additional labeled data. The approach bypasses the need to retrain a model from scratch for every new setup and dramatically reduces the labeled data requirement. This survey provides an in-depth review of deep transfer learning, examining the problem settings of transfer learning and classifying the prevailing deep transfer learning methods. Moreover, we delve into applying deep transfer learning in the context of a broad spectrum of time series anomaly detection tasks prevalent in primary industrial domains, e.g., manufacturing process monitoring, predictive maintenance, energy management, and infrastructure facility monitoring. We conclude this survey by underlining the challenges and limitations of deep transfer learning in industrial contexts. We also provide practical directions for solution design and implementation for these tasks, leading to specific, actionable suggestions.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/09/2021

Towards Deep Industrial Transfer Learning for Anomaly Detection on Time Series Data

Deep learning promises performant anomaly detection on time-variant data...
research
04/06/2022

Dimensionality Expansion and Transfer Learning for Next Generation Energy Management Systems

Electrical management systems (EMS) are playing a central role in enabli...
research
03/09/2022

Transfer Learning as an Essential Tool for Digital Twins in Renewable Energy Systems

Transfer learning (TL), the next frontier in machine learning (ML), has ...
research
01/04/2023

A Survey on Deep Industrial Transfer Learning in Fault Prognostics

Due to its probabilistic nature, fault prognostics is a prime example of...
research
04/04/2022

Towards Deep Industrial Transfer Learning: Clustering for Transfer Case Selection

Industrial transfer learning increases the adaptability of deep learning...
research
04/23/2018

Taskonomy: Disentangling Task Transfer Learning

Do visual tasks have a relationship, or are they unrelated? For instance...
research
04/04/2022

Stuttgart Open Relay Degradation Dataset (SOReDD)

Real-life industrial use cases for machine learning oftentimes involve h...

Please sign up or login with your details

Forgot password? Click here to reset