Automatic Learning to Detect Concept Drift

05/04/2021
by   Hang Yu, et al.
6

Many methods have been proposed to detect concept drift, i.e., the change in the distribution of streaming data, due to concept drift causes a decrease in the prediction accuracy of algorithms. However, the most of current detection methods are based on the assessment of the degree of change in the data distribution, cannot identify the type of concept drift. In this paper, we propose Active Drift Detection with Meta learning (Meta-ADD), a novel framework that learns to classify concept drift by tracking the changed pattern of error rates. Specifically, in the training phase, we extract meta-features based on the error rates of various concept drift, after which a meta-detector is developed via a prototypical neural network by representing various concept drift classes as corresponding prototypes. In the detection phase, the learned meta-detector is fine-tuned to adapt to the corresponding data stream via stream-based active learning. Hence, Meta-ADD uses machine learning to learn to detect concept drifts and identify their types automatically, which can directly support drift understand. The experiment results verify the effectiveness of Meta-ADD.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/24/2018

Handling Adversarial Concept Drift in Streaming Data

Classifiers operating in a dynamic, real world environment, are vulnerab...
research
07/28/2020

Diagnosing Concept Drift with Visual Analytics

Concept drift is a phenomenon in which the distribution of a data stream...
research
04/24/2020

Concept Drift Detection via Equal Intensity k-means Space Partitioning

Data stream poses additional challenges to statistical classification ta...
research
07/27/2022

Detecting Concept Drift in the Presence of Sparsity – A Case Study of Automated Change Risk Assessment System

Missing values, widely called as sparsity in literature, is a common cha...
research
09/16/2021

Soft Confusion Matrix Classifier for Stream Classification

In this paper, the issue of tailoring the soft confusion matrix (SCM) ba...
research
05/19/2023

OPTWIN: Drift identification with optimal sub-windows

Online Learning (OL) is a field of research that is increasingly gaining...
research
09/07/2017

Reservoir of Diverse Adaptive Learners and Stacking Fast Hoeffding Drift Detection Methods for Evolving Data Streams

The last decade has seen a surge of interest in adaptive learning algori...

Please sign up or login with your details

Forgot password? Click here to reset