Deep Anomaly Detection in Packet Payload

12/05/2019
by   Jiaxin Liu, et al.
0

With the widespread adoption of cloud services, especially the extensive deployment of plenty of Web applications, it is important and challenging to detect anomalies from the packet payload. For example, the anomalies in the packet payload can be expressed as a number of specific strings which may cause attacks. Although some approaches have achieved remarkable progress, they are with limited applications since they are dependent on in-depth expert knowledge, e.g., signatures describing anomalies or communication protocol at the application level. Moreover, they might fail to detect the payload anomalies that have long-term dependency relationships. To overcome these limitations and adaptively detect anomalies from the packet payload, we propose a deep learning based framework which consists of two steps. First, a novel feature engineering method is proposed to obtain the block-based features via block sequence extraction and block embedding. The block-based features could encapsulate both the high-dimension information and the underlying sequential information which facilitate the anomaly detection. Second, a neural network is designed to learn the representation of packet payload based on Long Short-Term Memory (LSTM) and Convolutional Neural Networks (CNN). Furthermore, we cast the anomaly detection as a classification problem and stack a Multi-Layer Perception (MLP) on the above representation learning network to detect anomalies. Extensive experimental results on three public datasets indicate that our model could achieve a higher detection rate, while keeping a lower false positive rate compared with five state-of-the-art methods.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/08/2021

Minimal-Configuration Anomaly Detection for IIoT Sensors

The increasing deployment of low-cost IoT sensor platforms in industry b...
research
10/09/2019

Sequential VAE-LSTM for Anomaly Detection on Time Series

In order to support stable web-based applications and services, anomalie...
research
09/28/2022

Big data analysis and distributed deep learning for next-generation intrusion detection system optimization

With the growing use of information technology in all life domains, hack...
research
07/19/2020

Deep Anomaly Detection for Time-series Data in Industrial IoT: A Communication-Efficient On-device Federated Learning Approach

Since edge device failures (i.e., anomalies) seriously affect the produc...
research
04/12/2021

Using a Neural Network to Detect Anomalies given an N-gram Profile

In order to detect unknown intrusions and runtime errors of computer pro...
research
03/31/2023

Long-Short Temporal Co-Teaching for Weakly Supervised Video Anomaly Detection

Weakly supervised video anomaly detection (WS-VAD) is a challenging prob...
research
08/24/2022

Transformer-Boosted Anomaly Detection with Fuzzy Hashes

Fuzzy hashes are an important tool in digital forensics and are used in ...

Please sign up or login with your details

Forgot password? Click here to reset