Likelihood-ratio calibration using prior-weighted proper scoring rules

07/30/2013
by   Niko Brümmer, et al.
0

Prior-weighted logistic regression has become a standard tool for calibration in speaker recognition. Logistic regression is the optimization of the expected value of the logarithmic scoring rule. We generalize this via a parametric family of proper scoring rules. Our theoretical analysis shows how different members of this family induce different relative weightings over a spectrum of applications of which the decision thresholds range from low to high. Special attention is given to the interaction between prior weighting and proper scoring rule parameters. Experiments on NIST SRE'12 suggest that for applications with low false-alarm rate requirements, scoring rules tailored to emphasize higher score thresholds may give better accuracy than logistic regression.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/02/2021

A Proper Scoring Rule for Validation of Competing Risks Models

Scoring rules are used to evaluate the quality of predictions that take ...
research
04/08/2013

The PAV algorithm optimizes binary proper scoring rules

There has been much recent interest in application of the pool-adjacent-...
research
04/18/2021

Tutorial on logistic-regression calibration and fusion: Converting a score to a likelihood ratio

Logistic-regression calibration and fusion are potential steps in the ca...
research
06/19/2018

Properization

Scoring rules serve to quantify predictive performance. A scoring rule i...
research
12/12/2011

Threshold Choice Methods: the Missing Link

Many performance metrics have been introduced for the evaluation of clas...
research
07/15/2021

Credit scoring using neural networks and SURE posterior probability calibration

In this article we compare the performances of a logistic regression and...
research
12/11/2018

Identification of Cancer - Mesothelioma Disease Using Logistic Regression and Association Rule

Malignant Pleural Mesothelioma (MPM) or malignant mesothelioma (MM) is a...

Please sign up or login with your details

Forgot password? Click here to reset