Likelihood-ratio-based confidence intervals for neural networks

08/04/2023
by   Laurens Sluijterman, et al.
0

This paper introduces a first implementation of a novel likelihood-ratio-based approach for constructing confidence intervals for neural networks. Our method, called DeepLR, offers several qualitative advantages: most notably, the ability to construct asymmetric intervals that expand in regions with a limited amount of data, and the inherent incorporation of factors such as the amount of training time, network architecture, and regularization techniques. While acknowledging that the current implementation of the method is prohibitively expensive for many deep-learning applications, the high cost may already be justified in specific fields like medical predictions or astrophysics, where a reliable uncertainty estimate for a single prediction is essential. This work highlights the significant potential of a likelihood-ratio-based uncertainty estimate and establishes a promising avenue for future research.

READ FULL TEXT

page 2

page 17

page 18

page 20

page 21

research
07/12/2018

Jackknife empirical likelihood based inference for Probability weighted moments

In the present article, we discuss jackknife empirical likelihood (JEL) ...
research
12/16/2014

Testing and Confidence Intervals for High Dimensional Proportional Hazards Model

This paper proposes a decorrelation-based approach to test hypotheses an...
research
04/01/2020

A robust and efficient algorithm to find profile likelihood confidence intervals

Profile likelihood confidence intervals are a robust alternative to Wald...
research
12/27/2022

Uncertainty-Aware Performance Prediction for Highly Configurable Software Systems via Bayesian Neural Networks

Configurable software systems are employed in many important application...
research
09/24/2018

Deep Confidence: A Computationally Efficient Framework for Calculating Reliable Errors for Deep Neural Networks

Deep learning architectures have proved versatile in a number of drug di...
research
06/14/2019

MonoLoco: Monocular 3D Pedestrian Localization and Uncertainty Estimation

We tackle the fundamentally ill-posed problem of 3D human localization f...
research
11/22/2019

Searching for new physics with profile likelihoods: Wilks and beyond

Particle physics experiments use likelihood ratio tests extensively to c...

Please sign up or login with your details

Forgot password? Click here to reset