Generalized Minimum Error with Fiducial Points Criterion for Robust Learning

09/09/2023
by   Haiquan Zhao, et al.
0

The conventional Minimum Error Entropy criterion (MEE) has its limitations, showing reduced sensitivity to error mean values and uncertainty regarding error probability density function locations. To overcome this, a MEE with fiducial points criterion (MEEF), was presented. However, the efficacy of the MEEF is not consistent due to its reliance on a fixed Gaussian kernel. In this paper, a generalized minimum error with fiducial points criterion (GMEEF) is presented by adopting the Generalized Gaussian Density (GGD) function as kernel. The GGD extends the Gaussian distribution by introducing a shape parameter that provides more control over the tail behavior and peakedness. In addition, due to the high computational complexity of GMEEF criterion, the quantized idea is introduced to notably lower the computational load of the GMEEF-type algorithm. Finally, the proposed criterions are introduced to the domains of adaptive filter, kernel recursive algorithm, and multilayer perceptron. Several numerical simulations, which contain system identification, acoustic echo cancellation, times series prediction, and supervised classification, indicate that the novel algorithms' performance performs excellently.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/12/2015

Generalized Correntropy for Robust Adaptive Filtering

As a robust nonlinear similarity measure in kernel space, correntropy ha...
research
10/11/2017

Quantized Minimum Error Entropy Criterion

Comparing with traditional learning criteria, such as mean square error ...
research
08/03/2012

Learning Theory Approach to Minimum Error Entropy Criterion

We consider the minimum error entropy (MEE) criterion and an empirical r...
research
08/07/2018

Granger Causality Analysis Based on Quantized Minimum Error Entropy Criterion

Linear regression model (LRM) based on mean square error (MSE) criterion...
research
02/17/2016

Peak Criterion for Choosing Gaussian Kernel Bandwidth in Support Vector Data Description

Support Vector Data Description (SVDD) is a machine-learning technique u...
research
06/15/2020

Layer-wise Learning of Kernel Dependence Networks

We propose a greedy strategy to train a deep network for multi-class cla...
research
09/21/2014

Approximation errors of online sparsification criteria

Many machine learning frameworks, such as resource-allocating networks, ...

Please sign up or login with your details

Forgot password? Click here to reset