Optimal ROC Curves from Score Variable Threshold Tests

12/15/2020
by   Catherine Medlock, et al.
0

The Receiver Operating Characteristic (ROC) is a well-established representation of the tradeoff between detection and false alarm probabilities in binary hypothesis testing. In many practical contexts ROC's are generated by thresholding a measured score variable – applying score variable threshold tests (SVT's). In many cases the resulting curve is different from the likelihood ratio test (LRT) ROC and is therefore not Neyman-Pearson optimal. While it is well-understood that concavity is a necessary condition for an ROC to be Neyman-Pearson optimal, this paper establishes that it is also a sufficient condition in the case where the ROC was generated using SVT's. It further defines a constructive procedure by which the LRT ROC can be generated from a non-concave SVT ROC, without requiring explicit knowledge of the conditional PDF's of the score variable. If the conditional PDF's are known, the procedure implicitly provides a way of redesigning the test so that it is equivalent to an LRT.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/04/2022

Maximum Likelihood Estimation of Optimal Receiver Operating Characteristic Curves from Likelihood Ratio Observations

The optimal receiver operating characteristic (ROC) curve, giving the ma...
research
07/04/2023

Threshold Testing and Semi-Online Prophet Inequalities

We study threshold testing, an elementary probing model with the goal to...
research
01/23/2022

Asymptotics for Outlier Hypothesis Testing

We revisit the outlier hypothesis testing framework of Li et al. (TIT 20...
research
06/01/2016

On the equivalence between Kolmogorov-Smirnov and ROC curve metrics for binary classification

Binary decisions are very common in artificial intelligence. Applying a ...
research
12/05/2019

Hypothesis testing for a Lévy-driven storage system by Poisson sampling

This paper focuses hypothesis testing for the input of a Lévy-driven sto...
research
04/06/2020

Performance evaluation and design for variable threshold alarm systems through semi-Markov process

In large industrial systems, alarm management is one of the most importa...
research
10/03/2015

P-trac Procedure: The Dispersion and Neutralization of Contrasts in Lexicon

Cognitive acoustic cues have an important role in shaping the phonologic...

Please sign up or login with your details

Forgot password? Click here to reset