An Incremental Construction of Deep Neuro Fuzzy System for Continual Learning of Non-stationary Data Streams

08/26/2018
by   Mahardhika Pratama, et al.
0

Existing fuzzy neural networks (FNNs) are mostly developed under a shallow network configuration having lower generalization power than those of deep structures. This paper proposes a novel self-organizing deep fuzzy neural network, namely deep evolving fuzzy neural networks (DEVFNN). Fuzzy rules can be automatically extracted from data streams or removed if they play little role during their lifespan. The structure of the network can be deepened on demand by stacking additional layers using a drift detection method which not only detects the covariate drift, variations of input space, but also accurately identifies the real drift, dynamic changes of both feature space and target space. DEVFNN is developed under the stacked generalization principle via the feature augmentation concept where a recently developed algorithm, namely Generic Classifier (gClass), drives the hidden layer. It is equipped by an automatic feature selection method which controls activation and deactivation of input attributes to induce varying subsets of input features. A deep network simplification procedure is put forward using the concept of hidden layer merging to prevent uncontrollable growth of input space dimension due to the nature of feature augmentation approach in building a deep network structure. DEVFNN works in the sample-wise fashion and is compatible for data stream applications. The efficacy of DEVFNN has been thoroughly evaluated using six datasets with non-stationary properties under the prequential test-then-train protocol. It has been compared with four state-of the art data stream methods and its shallow counterpart where DEVFNN demonstrates improvement of classification accuracy.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/17/2018

Autonomous Deep Learning: Continual Learning Approach for Dynamic Environments

The feasibility of deep neural networks (DNNs) to address data stream pr...
research
07/15/2019

ParaFIS:A new online fuzzy inference system based on parallel drift anticipation

This paper proposes a new architecture of incremen-tal fuzzy inference s...
research
09/24/2018

Autonomous Deep Learning: Incremental Learning of Denoising Autoencoder for Evolving Data Streams

The generative learning phase of Autoencoder (AE) and its successor Deno...
research
08/07/2018

Deep Stacked Stochastic Configuration Networks for Non-Stationary Data Streams

The concept of stochastic configuration networks (SCNs) others a solid f...
research
01/07/2021

Drift anticipation with forgetting to improve evolving fuzzy system

Working with a non-stationary stream of data requires for the analysis s...
research
11/10/2019

TSK-Streams: Learning TSK Fuzzy Systems on Data Streams

The problem of adaptive learning from evolving and possibly non-stationa...
research
10/08/2019

Automatic Construction of Multi-layer Perceptron Network from Streaming Examples

Autonomous construction of deep neural network (DNNs) is desired for dat...

Please sign up or login with your details

Forgot password? Click here to reset