Robust Stochastic Configuration Networks with Kernel Density Estimation

by   Dianhui Wang, et al.

Neural networks have been widely used as predictive models to fit data distribution, and they could be implemented through learning a collection of samples. In many applications, however, the given dataset may contain noisy samples or outliers which may result in a poor learner model in terms of generalization. This paper contributes to a development of robust stochastic configuration networks (RSCNs) for resolving uncertain data regression problems. RSCNs are built on original stochastic configuration networks with weighted least squares method for evaluating the output weights, and the input weights and biases are incrementally and randomly generated by satisfying with a set of inequality constrains. The kernel density estimation (KDE) method is employed to set the penalty weights for each training samples, so that some negative impacts, caused by noisy data or outliers, on the resulting learner model can be reduced. The alternating optimization technique is applied for updating a RSCN model with improved penalty weights computed from the kernel density estimation function. Performance evaluation is carried out by a function approximation, four benchmark datasets and a case study on engineering application. Comparisons to other robust randomised neural modelling techniques, including the probabilistic robust learning algorithm for neural networks with random weights and improved RVFL networks, indicate that the proposed RSCNs with KDE perform favourably and demonstrate good potential for real-world applications.


page 2

page 6

page 7

page 9

page 10

page 12

page 13

page 14


Stochastic Configuration Networks: Fundamentals and Algorithms

This paper contributes to a development of randomized methods for neural...

Deep Stochastic Configuration Networks with Universal Approximation Property

This paper develops a randomized approach for incrementally building dee...

Stochastic Configuration Networks Ensemble for Large-Scale Data Analytics

This paper presents a fast decorrelated neuro-ensemble with heterogeneou...

Stochastic Configuration Machines for Industrial Artificial Intelligence

Real-time predictive modelling with desired accuracy is highly expected ...

Deep PDF: Probabilistic Surface Optimization and Density Estimation

A probability density function (pdf) encodes the entire stochastic knowl...

Robust Simulation-Based Inference in Cosmology with Bayesian Neural Networks

Simulation-based inference (SBI) is rapidly establishing itself as a sta...

A Two-Stage Stochastic Programming Model for Car-Sharing Problem using Kernel Density Estimation

Car-sharing problem is a popular research field in sharing economy. In t...

Please sign up or login with your details

Forgot password? Click here to reset