Universal Neyman-Pearson Classification with a Known Hypothesis

06/23/2022
by   Parham Boroumand, et al.
0

We propose a universal classifier for binary Neyman-Pearson classification where null distribution is known while only a training sequence is available for the alternative distribution. The proposed classifier interpolates between Hoeffding's classifier and the likelihood ratio test and attains the same error probability prefactor as the likelihood ratio test, i.e., the same prefactor as if both distributions were known. In addition, like Hoeffding's universal hypothesis test, the proposed classifier is shown to attain the optimal error exponent tradeoff attained by the likelihood ratio test whenever the ratio of training to observation samples exceeds a certain value. We propose a lower bound and an upper bound to the training to observation ratio. In addition, we propose a sequential classifier that attains the optimal error exponent tradeoff.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/14/2021

Mismatched Binary Hypothesis Testing: Error Exponent Sensitivity

We study the problem of mismatched binary hypothesis testing between i.i...
research
10/09/2015

Some Theory For Practical Classifier Validation

We compare and contrast two approaches to validating a trained classifie...
research
01/12/2020

Error Exponents of Mismatched Likelihood Ratio Testing

We study the problem of mismatched likelihood ratio test. We analyze the...
research
08/31/2015

Wald-Kernel: Learning to Aggregate Information for Sequential Inference

Sequential hypothesis testing is a desirable decision making strategy in...
research
10/08/2016

A nonparametric sequential test for online randomized experiments

We propose a nonparametric sequential test that aims to address two prac...
research
03/27/2017

Adversarial Source Identification Game with Corrupted Training

We study a variant of the source identification game with training data ...

Please sign up or login with your details

Forgot password? Click here to reset