An Automated Machine Learning Approach for Detecting Anomalous Peak Patterns in Time Series Data from a Research Watershed in the Northeastern United States Critical Zone

09/14/2023
by   Ijaz Ul Haq, et al.
0

This paper presents an automated machine learning framework designed to assist hydrologists in detecting anomalies in time series data generated by sensors in a research watershed in the northeastern United States critical zone. The framework specifically focuses on identifying peak-pattern anomalies, which may arise from sensor malfunctions or natural phenomena. However, the use of classification methods for anomaly detection poses challenges, such as the requirement for labeled data as ground truth and the selection of the most suitable deep learning model for the given task and dataset. To address these challenges, our framework generates labeled datasets by injecting synthetic peak patterns into synthetically generated time series data and incorporates an automated hyperparameter optimization mechanism. This mechanism generates an optimized model instance with the best architectural and training parameters from a pool of five selected models, namely Temporal Convolutional Network (TCN), InceptionTime, MiniRocket, Residual Networks (ResNet), and Long Short-Term Memory (LSTM). The selection is based on the user's preferences regarding anomaly detection accuracy and computational cost. The framework employs Time-series Generative Adversarial Networks (TimeGAN) as the synthetic dataset generator. The generated model instances are evaluated using a combination of accuracy and computational cost metrics, including training time and memory, during the anomaly detection process. Performance evaluation of the framework was conducted using a dataset from a watershed, demonstrating consistent selection of the most fitting model instance that satisfies the user's preferences.

READ FULL TEXT

page 10

page 21

page 22

research
08/30/2022

Denoising Architecture for Unsupervised Anomaly Detection in Time-Series

Anomalies in time-series provide insights of critical scenarios across a...
research
04/19/2021

SALAD: Self-Adaptive Lightweight Anomaly Detection for Real-time Recurrent Time Series

Real-world time series data often present recurrent or repetitive patter...
research
07/19/2020

Deep Anomaly Detection for Time-series Data in Industrial IoT: A Communication-Efficient On-device Federated Learning Approach

Since edge device failures (i.e., anomalies) seriously affect the produc...
research
02/17/2023

Quantile LSTM: A Robust LSTM for Anomaly Detection In Time Series Data

Anomalies refer to the departure of systems and devices from their norma...
research
11/20/2018

A Deep Neural Network for Unsupervised Anomaly Detection and Diagnosis in Multivariate Time Series Data

Nowadays, multivariate time series data are increasingly collected in va...
research
11/11/2021

Exploiting the Power of Levenberg-Marquardt Optimizer with Anomaly Detection in Time Series

The Levenberg-Marquardt (LM) optimization algorithm has been widely used...
research
03/22/2023

TSI-GAN: Unsupervised Time Series Anomaly Detection using Convolutional Cycle-Consistent Generative Adversarial Networks

Anomaly detection is widely used in network intrusion detection, autonom...

Please sign up or login with your details

Forgot password? Click here to reset