Exchangeability, Conformal Prediction, and Rank Tests

05/13/2020
by   Arun Kumar Kuchibhotla, et al.
0

Conformal prediction has been a very popular method of distribution-free predictive inference in recent years in machine learning and statistics. The main reason for its popularity comes from the fact that it works as a wrapper around any prediction algorithm such as neural networks or random forests. Exchangeability is at the core of the validity of conformal prediction. The concept of exchangeability is also at the core of rank tests widely known in nonparametric statistics. In this paper, we review the concept of exchangeability and discuss its implications for rank tests and conformal prediction. Although written as an exposition, the main message of the paper is to show that similar to conformal prediction, rank tests can also be used as a wrapper around any dimension reduction algorithm.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/18/2022

Rank Based Tests for High Dimensional White Noise

The development of high-dimensional white noise test is important in bot...
research
02/23/2021

An Aligned Rank Transform Procedure for Multifactor Contrast Tests

Data from multifactor HCI experiments often violates the normality assum...
research
09/20/2018

New L^2-type exponentiality tests

We introduce new consistent and scale-free goodness-of-fit tests for the...
research
07/04/2020

Rate-optimality of consistent distribution-free tests of independence based on center-outward ranks and signs

Rank correlations have found many innovative applications in the last de...
research
07/30/2020

Fully distribution-free center-outward rank tests for multiple-output regression and MANOVA

Extending rank-based inference to a multivariate setting such as multipl...
research
11/14/2016

Feature Engineering and Ensemble Modeling for Paper Acceptance Rank Prediction

Measuring research impact and ranking academic achievement are important...
research
01/11/2021

Representativeness in Statistics, Politics, and Machine Learning

Representativeness is a foundational yet slippery concept. Though famili...

Please sign up or login with your details

Forgot password? Click here to reset