An efficient and straightforward online quantization method for a data stream through remove-birth updating

06/21/2023
by   Kazuhisa Fujita, et al.
0

The growth of network-connected devices is creating an explosion of data, known as big data, and posing significant challenges to efficient data analysis. This data is generated continuously, creating a dynamic flow known as a data stream. The characteristics of a data stream may change dynamically, and this change is known as concept drift. Consequently, a method for handling data streams must efficiently reduce their volume while dynamically adapting to these changing characteristics. This paper proposes a simple online vector quantization method for concept drift. The proposed method identifies and replaces units with low win probability through remove-birth updating, thus achieving a rapid adaptation to concept drift. Furthermore, the results of this study show that the proposed method can generate minimal dead units even in the presence of concept drift. This study also suggests that some metrics calculated from the proposed method will be helpful for drift detection.

READ FULL TEXT

page 12

page 15

research
10/07/2016

Adaptive Convolutional ELM For Concept Drift Handling in Online Stream Data

In big data era, the data continuously generated and its distribution ma...
research
04/13/2020

Diverse Instances-Weighting Ensemble based on Region Drift Disagreement for Concept Drift Adaptation

Concept drift refers to changes in the distribution of underlying data a...
research
03/14/2023

On the Connection between Concept Drift and Uncertainty in Industrial Artificial Intelligence

AI-based digital twins are at the leading edge of the Industry 4.0 revol...
research
11/07/2020

Enhash: A Fast Streaming Algorithm For Concept Drift Detection

We propose Enhash, a fast ensemble learner that detects concept drift in...
research
04/20/2021

Concept Drift Detection from Multi-Class Imbalanced Data Streams

Continual learning from data streams is among the most important topics ...
research
02/10/2019

Hybrid Forest: A Concept Drift Aware Data Stream Mining Algorithm

Nowadays with a growing number of online controlling systems in the orga...
research
10/07/2021

A Broad Ensemble Learning System for Drifting Stream Classification

Data stream classification has become a major research topic due to the ...

Please sign up or login with your details

Forgot password? Click here to reset