Deep Convolutional Neural Networks for Anomaly Event Classification on Distributed Systems

10/25/2017
by   Jiechao Cheng, et al.
0

The increasing popularity of server usage has brought a plenty of anomaly log events, which have threatened a vast collection of machines. Recognizing and categorizing the anomalous events thereby is a much salient work for our systems, especially the ones generate the massive amount of data and harness it for technology value creation and business development. To assist in focusing on the classification and the prediction of anomaly events, and gaining critical insights from system event records, we propose a novel log preprocessing method which is very effective to filter abundant information and retain critical characteristics. Additionally, a competitive approach for automated classification of anomalous events detected from the distributed system logs with the state-of-the-art deep (Convolutional Neural Network) architectures is proposed in this paper. We measure a series of deep CNN algorithms with varied hyper-parameter combinations by using standard evaluation metrics, the results of our study reveals the advantages and potential capabilities of the proposed deep CNN models for anomaly event classification tasks on real-world systems. The optimal classification precision of our approach is 98.14 machine learning methods.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 2

page 4

page 8

08/17/2019

Hybrid Deep Network for Anomaly Detection

In this paper, we propose a deep convolutional neural network (CNN) for ...
02/08/2019

BINet: Multi-perspective Business Process Anomaly Classification

In this paper, we introduce BINet, a neural network architecture for rea...
10/22/2020

Early Anomaly Detection in Time Series: A Hierarchical Approach for Predicting Critical Health Episodes

The early detection of anomalous events in time series data is essential...
03/31/2022

SIERRA: Ranking Anomalous Activities in Enterprise Networks

An enterprise today deploys multiple security middleboxes such as firewa...
11/27/2021

Distributed Anomaly Detection in Edge Streams using Frequency based Sketch Datastructures

Often logs hosted in large data centers represent network traffic data o...
01/04/2021

Anomaly Recognition from surveillance videos using 3D Convolutional Neural Networks

Anomalous activity recognition deals with identifying the patterns and e...
03/09/2022

Deep Convolutional Neural Network for Roadway Incident Surveillance Using Audio Data

Crash events identification and prediction plays a vital role in underst...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.