Venn-Abers predictors

10/31/2012
by   Vladimir Vovk, et al.
0

This paper continues study, both theoretical and empirical, of the method of Venn prediction, concentrating on binary prediction problems. Venn predictors produce probability-type predictions for the labels of test objects which are guaranteed to be well calibrated under the standard assumption that the observations are generated independently from the same distribution. We give a simple formalization and proof of this property. We also introduce Venn-Abers predictors, a new class of Venn predictors based on the idea of isotonic regression, and report promising empirical results both for Venn-Abers predictors and for their more computationally efficient simplified version.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/14/2020

Training conformal predictors

Efficiency criteria for conformal prediction, such as observed fuzziness...
research
02/25/2022

Alpha-NML Universal Predictors

Inspired by Sibson's alpha-mutual information, we introduce a new class ...
research
07/18/2023

Batched Predictors Generalize within Distribution

We study the generalization properties of batched predictors, i.e., mode...
research
03/13/2018

Building Better Quality Predictors Using "ε-Dominance"

Despite extensive research, many methods in software quality prediction ...
research
02/29/2020

Are You an Introvert or Extrovert? Accurate Classification With Only Ten Predictors

This paper investigates how accurately the prediction of being an introv...
research
11/03/2019

Computationally efficient versions of conformal predictive distributions

Conformal predictive systems are a recent modification of conformal pred...
research
07/04/2023

The Inner Sentiments of a Thought

Transformer-based large-scale language models (LLMs) are able to generat...

Please sign up or login with your details

Forgot password? Click here to reset