Predicting accurate probabilities with a ranking loss

06/18/2012
by   Aditya Menon, et al.
0

In many real-world applications of machine learning classifiers, it is essential to predict the probability of an example belonging to a particular class. This paper proposes a simple technique for predicting probabilities based on optimizing a ranking loss, followed by isotonic regression. This semi-parametric technique offers both good ranking and regression performance, and models a richer set of probability distributions than statistical workhorses such as logistic regression. We provide experimental results that show the effectiveness of this technique on real-world applications of probability prediction.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/24/2017

Calibration of Machine Learning Classifiers for Probability of Default Modelling

Binary classification is highly used in credit scoring in the estimation...
research
09/21/2019

Using theoretical ROC curves for analysing machine learning binary classifiers

Most binary classifiers work by processing the input to produce a scalar...
research
04/17/2018

Predicting Future Machine Failure from Machine State Using Logistic Regression

Accurately predicting machine failures in advance can decrease maintenan...
research
10/25/2020

Monocular Depth Estimation via Listwise Ranking using the Plackett-Luce Model

In many real-world applications, the relative depth of objects in an ima...
research
01/06/2018

Adversarial Perturbation Intensity Achieving Chosen Intra-Technique Transferability Level for Logistic Regression

Machine Learning models have been shown to be vulnerable to adversarial ...
research
10/16/2017

Calibrated Boosting-Forest

Excellent ranking power along with well calibrated probability estimates...
research
08/18/2022

Using Conformal Win Probability to Predict the Winners of the Cancelled 2020 NCAA Basketball Tournaments

The COVID-19 pandemic was responsible for the cancellation of both the m...

Please sign up or login with your details

Forgot password? Click here to reset