Cross-Validation and Uncertainty Determination for Randomized Neural Networks with Applications to Mobile Sensors

01/06/2021
by   Ansgar Steland, et al.
0

Randomized artificial neural networks such as extreme learning machines provide an attractive and efficient method for supervised learning under limited computing ressources and green machine learning. This especially applies when equipping mobile devices (sensors) with weak artificial intelligence. Results are discussed about supervised learning with such networks and regression methods in terms of consistency and bounds for the generalization and prediction error. Especially, some recent results are reviewed addressing learning with data sampled by moving sensors leading to non-stationary and dependent samples. As randomized networks lead to random out-of-sample performance measures, we study a cross-validation approach to handle the randomness and make use of it to improve out-of-sample performance. Additionally, a computationally efficient approach to determine the resulting uncertainty in terms of a confidence interval for the mean out-of-sample prediction error is discussed based on two-stage estimation. The approach is applied to a prediction problem arising in vehicle integrated photovoltaics.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/22/2020

Extreme Learning and Regression for Objects Moving in Non-Stationary Spatial Environments

We study supervised learning by extreme learning machines and regression...
research
06/30/2020

Conformal Prediction Intervals for Neural Networks Using Cross Validation

Neural networks are among the most powerful nonlinear models used to add...
research
01/09/2018

Test Error Estimation after Model Selection Using Validation Error

When performing supervised learning with the model selected using valida...
research
06/23/2017

Cross-validation failure: small sample sizes lead to large error bars

Predictive models ground many state-of-the-art developments in statistic...
research
06/02/2021

Hyperdimensional Computing for Efficient Distributed Classification with Randomized Neural Networks

In the supervised learning domain, considering the recent prevalence of ...
research
01/07/2020

Stochastic Local Interaction Model: Geostatistics without Kriging

Classical geostatistical methods face serious computational challenges i...

Please sign up or login with your details

Forgot password? Click here to reset