Concept Drift Detection: Dealing with MissingValues via Fuzzy Distance Estimations

08/09/2020
by   Anjin Liu, et al.
0

In data streams, the data distribution of arriving observations at different time points may change - a phenomenon called concept drift. While detecting concept drift is a relatively mature area of study, solutions to the uncertainty introduced by observations with missing values have only been studied in isolation. No one has yet explored whether or how these solutions might impact drift detection performance. We, however, believe that data imputation methods may actually increase uncertainty in the data rather than reducing it. We also conjecture that imputation can introduce bias into the process of estimating distribution changes during drift detection, which can make it more difficult to train a learning model. Our idea is to focus on estimating the distance between observations rather than estimating the missing values, and to define membership functions that allocate observations to histogram bins according to the estimation errors. Our solution comprises a novel masked distance learning (MDL) algorithm to reduce the cumulative errors caused by iteratively estimating each missing value in an observation and a fuzzy-weighted frequency (FWF) method for identifying discrepancies in the data distribution. The concept drift detection algorithm proposed in this paper is a singular and unified algorithm that can handle missing values, but not an imputation algorithm combined with a concept drift detection algorithm. Experiments on both synthetic and real-world data sets demonstrate the advantages of this method and show its robustness in detecting drift in data with missing values. These findings reveal that missing values exert a profound impact on concept drift detection, but using fuzzy set theory to model observations can produce more reliable results than imputation.

READ FULL TEXT

page 1

page 15

research
07/27/2022

Detecting Concept Drift in the Presence of Sparsity – A Case Study of Automated Change Risk Assessment System

Missing values, widely called as sparsity in literature, is a common cha...
research
09/25/2020

Online Missing Value Imputation and Correlation Change Detection for Mixed-type Data via Gaussian Copula

Most data science algorithms require complete observations, yet many dat...
research
03/16/2022

Resilient Neural Forecasting Systems

Industrial machine learning systems face data challenges that are often ...
research
10/24/2021

Detecting model drift using polynomial relations

Machine learning (ML) models serve critical functions, such as classifyi...
research
07/24/2019

Towards AutoML in the presence of Drift: first results

Research progress in AutoML has lead to state of the art solutions that ...
research
03/13/2020

DriftSurf: A Risk-competitive Learning Algorithm under Concept Drift

When learning from streaming data, a change in the data distribution, al...
research
03/14/2023

On the Connection between Concept Drift and Uncertainty in Industrial Artificial Intelligence

AI-based digital twins are at the leading edge of the Industry 4.0 revol...

Please sign up or login with your details

Forgot password? Click here to reset