DeepAI AI Chat
Log In Sign Up

Exponentially Weighted Moving Average Charts for Detecting Concept Drift

12/25/2012
by   Gordon J. Ross, et al.
Imperial College London
0

Classifying streaming data requires the development of methods which are computationally efficient and able to cope with changes in the underlying distribution of the stream, a phenomenon known in the literature as concept drift. We propose a new method for detecting concept drift which uses an Exponentially Weighted Moving Average (EWMA) chart to monitor the misclassification rate of an streaming classifier. Our approach is modular and can hence be run in parallel with any underlying classifier to provide an additional layer of concept drift detection. Moreover our method is computationally efficient with overhead O(1) and works in a fully online manner with no need to store data points in memory. Unlike many existing approaches to concept drift detection, our method allows the rate of false positive detections to be controlled and kept constant over time.

READ FULL TEXT

page 1

page 2

page 3

page 4

07/28/2020

Diagnosing Concept Drift with Visual Analytics

Concept drift is a phenomenon in which the distribution of a data stream...
12/12/2020

Concept Drift Monitoring and Diagnostics of Supervised Learning Models via Score Vectors

Supervised learning models are one of the most fundamental classes of mo...
04/04/2015

Concept Drift Detection for Streaming Data

Common statistical prediction models often require and assume stationari...
03/13/2020

DriftSurf: A Risk-competitive Learning Algorithm under Concept Drift

When learning from streaming data, a change in the data distribution, al...
12/07/2020

Passive Approach for the K-means Problem on Streaming Data

Currently the amount of data produced worldwide is increasing beyond mea...
02/11/2021

Tackling Virtual and Real Concept Drifts: An Adaptive Gaussian Mixture Model

Real-world applications have been dealing with large amounts of data tha...
10/04/2021

DenDrift: A Drift-Aware Algorithm for Host Profiling

Detecting and reacting to unauthorized actions is an essential task in s...