Fast and scalable neuroevolution deep learning architecture search for multivariate anomaly detection

12/10/2021
by   M. Pietron, et al.
0

Neuroevolution is one of the methodologies that can be used for learning optimal architecture during training. It uses evolutionary algorithms to generate the topology of artificial neural networks and its parameters. The main benefits are that it is scalable and can be fully or partially non gradient method. In this work, a modified neuroevolution technique is presented which incorporates multi-level optimisation. The presented approach adapts evolution strategies for evolving an ensemble model based on the bagging technique, using genetic operators for optimising single anomaly detection models, reducing the training dataset to speedup the search process and perform non-gradient fine tuning. Multivariate anomaly detection as an unsupervised learning task is the case study upon which the presented approach is tested. Single model optimisation is based on mutation and crossover operators and is focused on finding optimal window sizes, the number of layers, layer depths, hyperparameters etc. to boost the anomaly detection scores of new and already known models. The proposed framework and its protocol shows that it is possible to find architecture within a reasonable time frame which can boost all well known multivariate anomaly detection deep learning architectures. The work concentrates on improvements to the multi-level neuroevolution approach for anomaly detection. The main modifications are in the methods of mixing groups and single model evolution, non-gradient fine tuning and a voting mechanism. The presented framework can be used as an efficient learning network architecture method for any different unsupervised task where autoencoder architectures can be used. The tests were run on SWAT and WADI datasets and the presented approach evolved the architectures that achieved the best scores among other deep learning models.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/08/2021

Ensemble neuroevolution based approach for multivariate time series anomaly detection

Multivariate time series anomaly detection is a very common problem in t...
research
05/25/2023

AD-NEV: A Scalable Multi-level Neuroevolution Framework for Multivariate Anomaly Detection

Anomaly detection tools and methods present a key capability in modern c...
research
08/02/2023

Graph Anomaly Detection at Group Level: A Topology Pattern Enhanced Unsupervised Approach

Graph anomaly detection (GAD) has achieved success and has been widely a...
research
02/11/2022

Hybridization of Capsule and LSTM Networks for unsupervised anomaly detection on multivariate data

Deep learning techniques have recently shown promise in the field of ano...
research
03/31/2021

OutlierNets: Highly Compact Deep Autoencoder Network Architectures for On-Device Acoustic Anomaly Detection

Human operators often diagnose industrial machinery via anomalous sounds...
research
06/25/2010

Artificial Immune Systems (2010)

The human immune system has numerous properties that make it ripe for ex...
research
12/15/2022

A scalable framework for annotating photovoltaic cell defects in electroluminescence images

The correct functioning of photovoltaic (PV) cells is critical to ensuri...

Please sign up or login with your details

Forgot password? Click here to reset