DeepAI AI Chat
Log In Sign Up

Improving Scalability of Contrast Pattern Mining for Network Traffic Using Closed Patterns

by   Elaheh AlipourChavary, et al.

Contrast pattern mining (CPM) aims to discover patterns whose support increases significantly from a background dataset compared to a target dataset. CPM is particularly useful for characterising changes in evolving systems, e.g., in network traffic analysis to detect unusual activity. While most existing techniques focus on extracting either the whole set of contrast patterns (CPs) or minimal sets, the problem of efficiently finding a relevant subset of CPs, especially in high dimensional datasets, is an open challenge. In this paper, we focus on extracting the most specific set of CPs to discover significant changes between two datasets. Our approach to this problem uses closed patterns to substantially reduce redundant patterns. Our experimental results on several real and emulated network traffic datasets demonstrate that our proposed unsupervised algorithm is up to 100 times faster than an existing approach for CPM on network traffic data [2]. In addition, as an application of CPs, we demonstrate that CPM is a highly effective method for detection of meaningful changes in network traffic.


One-off Negative Sequential Pattern Mining

Negative sequential pattern mining (SPM) is an important SPM research to...

Mining compact high utility sequential patterns

High utility sequential pattern mining (HUSPM) aims to mine all patterns...

Statistically Significant Discriminative Patterns Searching

Discriminative pattern mining is an essential task of data mining. This ...

DANTE: A framework for mining and monitoring darknet traffic

Trillions of network packets are sent over the Internet to destinations ...

The Long and the Short of It: Summarising Event Sequences with Serial Episodes

An ideal outcome of pattern mining is a small set of informative pattern...

Hybrid ASP-based Approach to Pattern Mining

Detecting small sets of relevant patterns from a given dataset is a cent...

DwarvesGraph: A High-Performance Graph Mining System with Pattern Decomposition

Graph mining tasks, which focus on extracting structural information fro...