PAC-Bayesian High Dimensional Bipartite Ranking

11/09/2015
by   Benjamin Guedj, et al.
0

This paper is devoted to the bipartite ranking problem, a classical statistical learning task, in a high dimensional setting. We propose a scoring and ranking strategy based on the PAC-Bayesian approach. We consider nonlinear additive scoring functions, and we derive non-asymptotic risk bounds under a sparsity assumption. In particular, oracle inequalities in probability holding under a margin condition assess the performance of our procedure, and prove its minimax optimality. An MCMC-flavored algorithm is proposed to implement our method, along with its behavior on synthetic and real-life datasets.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/07/2022

Concentration analysis of multivariate elliptic diffusion processes

We prove concentration inequalities and associated PAC bounds for contin...
research
10/07/2014

PAC-Bayesian AUC classification and scoring

We develop a scoring and classification procedure based on the PAC-Bayes...
research
08/13/2011

Ensemble Risk Modeling Method for Robust Learning on Scarce Data

In medical risk modeling, typical data are "scarce": they have relativel...
research
03/14/2016

A ranking approach to global optimization

We consider the problem of maximizing an unknown function over a compact...
research
02/19/2020

Learning Fair Scoring Functions: Fairness Definitions, Algorithms and Generalization Bounds for Bipartite Ranking

Many applications of artificial intelligence, ranging from credit lendin...
research
12/18/2013

Functional Bipartite Ranking: a Wavelet-Based Filtering Approach

It is the main goal of this article to address the bipartite ranking iss...
research
04/07/2021

Concentration Inequalities for Two-Sample Rank Processes with Application to Bipartite Ranking

The ROC curve is the gold standard for measuring the performance of a te...

Please sign up or login with your details

Forgot password? Click here to reset