Optimal Uncertainty-guided Neural Network Training

12/30/2019
by   H M Dipu Kabir, et al.
0

The neural network (NN)-based direct uncertainty quantification (UQ) methods have achieved the state of the art performance since the first inauguration, known as the lower-upper-bound estimation (LUBE) method. However, currently-available cost functions for uncertainty guided NN training are not always converging and all converged NNs are not generating optimized prediction intervals (PIs). Moreover, several groups have proposed different quality criteria for PIs. These raise a question about their relative effectiveness. Most of the existing cost functions of uncertainty guided NN training are not customizable and the convergence of training is uncertain. Therefore, in this paper, we propose a highly customizable smooth cost function for developing NNs to construct optimal PIs. The optimized average width of PIs, PI-failure distances and the PI coverage probability (PICP) are computed for the test dataset. The performance of the proposed method is examined for the wind power generation and the electricity demand data. Results show that the proposed method reduces variation in the quality of PIs, accelerates the training, and improves convergence probability from 99.2

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/27/2023

Uncertainty Aware Neural Network from Similarity and Sensitivity

Researchers have proposed several approaches for neural network (NN) bas...
research
03/10/2023

Uncertainty quantification in neural network classifiers – a local linear approach

Classifiers based on neural networks (NN) often lack a measure of uncert...
research
10/31/2022

Evaluating Point-Prediction Uncertainties in Neural Networks for Drug Discovery

Neural Network (NN) models provide potential to speed up the drug discov...
research
01/10/2023

Optimal Power Flow Based on Physical-Model-Integrated Neural Network with Worth-Learning Data Generation

Fast and reliable solvers for optimal power flow (OPF) problems are attr...
research
07/11/2012

Discretized Approximations for POMDP with Average Cost

In this paper, we propose a new lower approximation scheme for POMDP wit...
research
06/28/2023

UTOPIA: Universally Trainable Optimal Prediction Intervals Aggregation

Uncertainty quantification for prediction is an intriguing problem with ...
research
01/03/2022

Neural network training under semidefinite constraints

This paper is concerned with the training of neural networks (NNs) under...

Please sign up or login with your details

Forgot password? Click here to reset