Measuring Classification Decision Certainty and Doubt

03/25/2023
by   Alexander M. Berenbeim, et al.
0

Quantitative characterizations and estimations of uncertainty are of fundamental importance in optimization and decision-making processes. Herein, we propose intuitive scores, which we call certainty and doubt, that can be used in both a Bayesian and frequentist framework to assess and compare the quality and uncertainty of predictions in (multi-)classification decision machine learning problems.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/25/2021

Emulation of physical processes with Emukit

Decision making in uncertain scenarios is an ubiquitous challenge in rea...
research
03/13/2013

Some Problems for Convex Bayesians

We discuss problems for convex Bayesian decision making and uncertainty ...
research
02/27/2020

Opportunities of a Machine Learning-based Decision Support System for Stroke Rehabilitation Assessment

Rehabilitation assessment is critical to determine an adequate intervent...
research
07/12/2020

Exploiting Uncertainties from Ensemble Learners to Improve Decision-Making in Healthcare AI

Ensemble learning is widely applied in Machine Learning (ML) to improve ...
research
04/08/2019

Bounded rational decision-making from elementary computations that reduce uncertainty

In its most basic form, decision-making can be viewed as a computational...
research
05/05/2013

Efficient Estimation of the number of neighbours in Probabilistic K Nearest Neighbour Classification

Probabilistic k-nearest neighbour (PKNN) classification has been introdu...
research
02/14/2012

Dynamic consistency and decision making under vacuous belief

The ideas about decision making under ignorance in economics are combine...

Please sign up or login with your details

Forgot password? Click here to reset