DeepAI AI Chat
Log In Sign Up

Broad Learning System Based on Maximum Correntropy Criterion

12/24/2019
by   Yunfei Zheng, et al.
Xi'an Jiaotong University
ia.ac.cn
Southwest University
43

As an effective and efficient discriminative learning method, Broad Learning System (BLS) has received increasing attention due to its outstanding performance in various regression and classification problems. However, the standard BLS is derived under the minimum mean square error (MMSE) criterion, which is, of course, not always a good choice due to its sensitivity to outliers. To enhance the robustness of BLS, we propose in this work to adopt the maximum correntropy criterion (MCC) to train the output weights, obtaining a correntropy based broad learning system (C-BLS). Thanks to the inherent superiorities of MCC, the proposed C-BLS is expected to achieve excellent robustness to outliers while maintaining the original performance of the standard BLS in Gaussian or noise-free environment. In addition, three alternative incremental learning algorithms, derived from a weighted regularized least-squares solution rather than pseudoinverse formula, for C-BLS are developed.With the incremental learning algorithms, the system can be updated quickly without the entire retraining process from the beginning, when some new samples arrive or the network deems to be expanded. Experiments on various regression and classification datasets are reported to demonstrate the desirable performance of the new methods.

READ FULL TEXT

page 3

page 4

page 5

page 6

page 7

page 8

page 12

page 13

08/08/2015

Diffusion Maximum Correntropy Criterion Algorithms for Robust Distributed Estimation

Robust diffusion adaptive estimation algorithms based on the maximum cor...
04/12/2015

Generalized Correntropy for Robust Adaptive Filtering

As a robust nonlinear similarity measure in kernel space, correntropy ha...
03/23/2017

Robustness of Maximum Correntropy Estimation Against Large Outliers

The maximum correntropy criterion (MCC) has recently been successfully a...
04/02/2020

Numerical analysis of least squares and perceptron learning for classification problems

This work presents study on regularized and non-regularized versions of ...
12/31/2019

Efficient Decremental Learning Algorithms for Broad Learning System

The decremented learning algorithms are required in machine learning, to...
10/11/2017

Quantized Minimum Error Entropy Criterion

Comparing with traditional learning criteria, such as mean square error ...