Robust Bayesian Classification Using an Optimistic Score Ratio

07/08/2020
by   Viet Anh Nguyen, et al.
0

We build a Bayesian contextual classification model using an optimistic score ratio for robust binary classification when there is limited information on the class-conditional, or contextual, distribution. The optimistic score searches for the distribution that is most plausible to explain the observed outcomes in the testing sample among all distributions belonging to the contextual ambiguity set which is prescribed using a limited structural constraint on the mean vector and the covariance matrix of the underlying contextual distribution. We show that the Bayesian classifier using the optimistic score ratio is conceptually attractive, delivers solid statistical guarantees and is computationally tractable. We showcase the power of the proposed optimistic score ratio classifier on both synthetic and empirical data.

READ FULL TEXT

page 8

page 9

research
01/19/2022

About limiting spectral distributions of block-rescaled empirical covariance matrices

We establish that the limiting spectral distribution of a block-rescaled...
research
03/22/2021

Optimal Linear Classification via Eigenvalue Shrinkage: The Case of Additive Noise

In this paper, we consider the general problem of testing the mean of tw...
research
05/18/2018

Distributionally Robust Inverse Covariance Estimation: The Wasserstein Shrinkage Estimator

We introduce a distributionally robust maximum likelihood estimation mod...
research
10/26/2018

Empirical Evaluation of Contextual Policy Search with a Comparison-based Surrogate Model and Active Covariance Matrix Adaptation

Contextual policy search (CPS) is a class of multi-task reinforcement le...
research
03/04/2018

Generalized Information Ratio

This paper proposes the Generalized Information Ratio (GIR) to evaluate ...
research
10/11/2018

Classification using margin pursuit

In this work, we study a new approach to optimizing the margin distribut...
research
02/15/2018

A Weighted Likelihood Approach Based on Statistical Data Depths

We propose a general approach to construct weighted likelihood estimatin...

Please sign up or login with your details

Forgot password? Click here to reset