Tackling Virtual and Real Concept Drifts: An Adaptive Gaussian Mixture Model

02/11/2021
by   Gustavo Oliveira, et al.
0

Real-world applications have been dealing with large amounts of data that arrive over time and generally present changes in their underlying joint probability distribution, i.e., concept drift. Concept drift can be subdivided into two types: virtual drift, which affects the unconditional probability distribution p(x), and real drift, which affects the conditional probability distribution p(y|x). Existing works focuses on real drift. However, strategies to cope with real drift may not be the best suited for dealing with virtual drift, since the real class boundaries remain unchanged. We provide the first in depth analysis of the differences between the impact of virtual and real drifts on classifiers' suitability. We propose an approach to handle both drifts called On-line Gaussian Mixture Model With Noise Filter For Handling Virtual and Real Concept Drifts (OGMMF-VRD). Experiments with 7 synthetic and 3 real-world datasets show that OGMMF-VRD obtained the best results in terms of average accuracy, G-mean and runtime compared to existing approaches. Moreover, its accuracy over time suffered less performance degradation in the presence of drifts.

READ FULL TEXT
research
09/08/2018

Handling Concept Drift via Model Reuse

In many real-world applications, data are often collected in the form of...
research
10/19/2020

Learning Parameter Distributions to Detect Concept Drift in Data Streams

Data distributions in streaming environments are usually not stationary....
research
09/25/2019

Online Semi-Supervised Concept Drift Detection with Density Estimation

Concept drift is formally defined as the change in joint distribution of...
research
07/27/2022

Concept Drift Challenge in Multimedia Anomaly Detection: A Case Study with Facial Datasets

Anomaly detection in multimedia datasets is a widely studied area. Yet, ...
research
05/25/2023

Detecting Dataset Drift and Non-IID Sampling via k-Nearest Neighbors

We present a straightforward statistical test to detect certain violatio...
research
10/10/2018

Adaptive Fraud Detection System Using Dynamic Risk Features

eCommerce transaction frauds keep changing rapidly. This is the major is...

Please sign up or login with your details

Forgot password? Click here to reset