Multi-Kernel Fusion for RBF Neural Networks

07/06/2020
by   Syed Muhammad Atif, et al.
8

A simple yet effective architectural design of radial basis function neural networks (RBFNN) makes them amongst the most popular conventional neural networks. The current generation of radial basis function neural network is equipped with multiple kernels which provide significant performance benefits compared to the previous generation using only a single kernel. In existing multi-kernel RBF algorithms, multi-kernel is formed by the convex combination of the base/primary kernels. In this paper, we propose a novel multi-kernel RBFNN in which every base kernel has its own (local) weight. This novel flexibility in the network provides better performance such as faster convergence rate, better local minima and resilience against stucking in poor local minima. These performance gains are achieved at a competitive computational complexity compared to the contemporary multi-kernel RBF algorithms. The proposed algorithm is thoroughly analysed for performance gain using mathematical and graphical illustrations and also evaluated on three different types of problems namely: (i) pattern classification, (ii) system identification and (iii) function approximation. Empirical results clearly show the superiority of the proposed algorithm compared to the existing state-of-the-art multi-kernel approaches.

READ FULL TEXT

page 20

page 21

research
05/09/2019

A Novel Adaptive Kernel for the RBF Neural Networks

In this paper, we propose a novel adaptive kernel for the radial basis f...
research
06/20/2018

Self-weighted Multiple Kernel Learning for Graph-based Clustering and Semi-supervised Classification

Multiple kernel learning (MKL) method is generally believed to perform b...
research
02/22/2021

Escaping Poor Local Minima in Large Scale Robust Estimation

Robust parameter estimation is a crucial task in several 3D computer vis...
research
10/15/2022

Controlling Travel Path of Original Cobra

In this paper we propose a kernel based COBRA which is a direct approxim...
research
01/09/2017

Tunable GMM Kernels

The recently proposed "generalized min-max" (GMM) kernel can be efficien...
research
02/26/2019

Implicit Kernel Learning

Kernels are powerful and versatile tools in machine learning and statist...
research
05/15/2022

Generalization Bounds on Multi-Kernel Learning with Mixed Datasets

This paper presents novel generalization bounds for the multi-kernel lea...

Please sign up or login with your details

Forgot password? Click here to reset