A New Learning Paradigm for Random Vector Functional-Link Network: RVFL+

08/28/2017
by   Peng-Bo Zhang, et al.
0

In school, a teacher plays an important role in various classroom teaching patterns. Likewise to this human learning activity, the learning using privileged information (LUPI) paradigm provides additional information generated by the teacher to 'teach' learning algorithms during the training stage. Therefore, this novel learning paradigm is a typical Teacher-Student Interaction mechanism. This paper is the first to present a random vector functional link network based on the LUPI paradigm, called RVFL+. Rather than simply combining two existing approaches, the newly-derived RVFL+ fills the gap between neural networks and the LUPI paradigm, which offers an alternative way to train RVFL networks. Moreover, the proposed RVFL+ can perform in conjunction with the kernel trick for highly complicated nonlinear feature learning, which is termed KRVFL+. Furthermore, the statistical property of the proposed RVFL+ is investigated, and we derive a sharp and high-quality generalization error bound based on the Rademacher complexity. Competitive experimental results on 14 real-world datasets illustrate the great effectiveness and efficiency of the novel RVFL+ and KRVFL+, which can achieve better generalization performance than state-of-the-art algorithms.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/11/2022

A New Learning Paradigm for Stochastic Configuration Network: SCN+

Learning using privileged information (LUPI) paradigm, which pioneered t...
research
04/10/2017

Parsimonious Random Vector Functional Link Network for Data Streams

The theory of random vector functional link network (RVFLN) has provided...
research
02/28/2017

Scaffolding Networks: Incremental Learning and Teaching Through Questioning

We introduce a new paradigm of learning for reasoning, understanding, an...
research
05/09/2018

Learning to Teach

Teaching plays a very important role in our society, by spreading human ...
research
07/30/2018

Robust Student Network Learning

Deep neural networks bring in impressive accuracy in various application...
research
02/05/2021

Robust Adaptive Filtering Based on Exponential Functional Link Network

The exponential functional link network (EFLN) has been recently investi...

Please sign up or login with your details

Forgot password? Click here to reset