Broad Learning System Based on Maximum Correntropy Criterion

12/24/2019
by   Yunfei Zheng, et al.
43

As an effective and efficient discriminative learning method, Broad Learning System (BLS) has received increasing attention due to its outstanding performance in various regression and classification problems. However, the standard BLS is derived under the minimum mean square error (MMSE) criterion, which is, of course, not always a good choice due to its sensitivity to outliers. To enhance the robustness of BLS, we propose in this work to adopt the maximum correntropy criterion (MCC) to train the output weights, obtaining a correntropy based broad learning system (C-BLS). Thanks to the inherent superiorities of MCC, the proposed C-BLS is expected to achieve excellent robustness to outliers while maintaining the original performance of the standard BLS in Gaussian or noise-free environment. In addition, three alternative incremental learning algorithms, derived from a weighted regularized least-squares solution rather than pseudoinverse formula, for C-BLS are developed.With the incremental learning algorithms, the system can be updated quickly without the entire retraining process from the beginning, when some new samples arrive or the network deems to be expanded. Experiments on various regression and classification datasets are reported to demonstrate the desirable performance of the new methods.

READ FULL TEXT

page 3

page 4

page 5

page 6

page 7

page 8

page 12

page 13

research
08/08/2015

Diffusion Maximum Correntropy Criterion Algorithms for Robust Distributed Estimation

Robust diffusion adaptive estimation algorithms based on the maximum cor...
research
04/12/2015

Generalized Correntropy for Robust Adaptive Filtering

As a robust nonlinear similarity measure in kernel space, correntropy ha...
research
03/23/2017

Robustness of Maximum Correntropy Estimation Against Large Outliers

The maximum correntropy criterion (MCC) has recently been successfully a...
research
04/02/2020

Numerical analysis of least squares and perceptron learning for classification problems

This work presents study on regularized and non-regularized versions of ...
research
04/11/2015

Quick sensitivity analysis for incremental data modification and its application to leave-one-out CV in linear classification problems

We introduce a novel sensitivity analysis framework for large scale clas...
research
12/31/2019

Efficient Decremental Learning Algorithms for Broad Learning System

The decremented learning algorithms are required in machine learning, to...
research
04/13/2019

Maximum Correntropy Criterion with Variable Center

Correntropy is a local similarity measure defined in kernel space and th...

Please sign up or login with your details

Forgot password? Click here to reset