Sequential three-way decisions with a single hidden layer feedforward neural network

03/14/2023
by   Youxi Wu, et al.
0

The three-way decisions strategy has been employed to construct network topology in a single hidden layer feedforward neural network (SFNN). However, this model has a general performance, and does not consider the process costs, since it has fixed threshold parameters. Inspired by the sequential three-way decisions (STWD), this paper proposes STWD with an SFNN (STWD-SFNN) to enhance the performance of networks on structured datasets. STWD-SFNN adopts multi-granularity levels to dynamically learn the number of hidden layer nodes from coarse to fine, and set the sequential threshold parameters. Specifically, at the coarse granular level, STWD-SFNN handles easy-to-classify instances by applying strict threshold conditions, and with the increasing number of hidden layer nodes at the fine granular level, STWD-SFNN focuses more on disposing of the difficult-to-classify instances by applying loose threshold conditions, thereby realizing the classification of instances. Moreover, STWD-SFNN considers and reports the process cost produced from each granular level. The experimental results verify that STWD-SFNN has a more compact network on structured datasets than other SFNN models, and has better generalization performance than the competitive models. All models and datasets can be downloaded from https://github.com/wuc567/Machine-learning/tree/main/STWD-SFNN.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/22/2020

Approximation capability of two hidden layer feedforward neural networks with fixed weights

We algorithmically construct a two hidden layer feedforward neural netwo...
research
08/21/2017

On the approximation by single hidden layer feedforward neural networks with fixed weights

Feedforward neural networks have wide applicability in various disciplin...
research
02/10/2019

An Algorithm for Approximating Continuous Functions on Compact Subsets with a Neural Network with one Hidden Layer

George Cybenko's landmark 1989 paper showed that there exists a feedforw...
research
05/06/2014

Pulling back error to the hidden-node parameter technology: Single-hidden-layer feedforward network without output weight

According to conventional neural network theories, the feature of single...
research
09/04/2019

A Constructive Approach for Data-Driven Randomized Learning of Feedforward Neural Networks

Feedforward neural networks with random hidden nodes suffer from a probl...
research
12/28/2020

Adaptive Threshold for Better Performance of the Recognition and Re-identification Models

Choosing a decision threshold is one of the challenging job in any class...
research
07/28/2023

Multiple Instance Learning Framework with Masked Hard Instance Mining for Whole Slide Image Classification

The whole slide image (WSI) classification is often formulated as a mult...

Please sign up or login with your details

Forgot password? Click here to reset