Bayesian Active Learning for Classification and Preference Learning

12/24/2011
by   Neil Houlsby, et al.
0

Information theoretic active learning has been widely studied for probabilistic models. For simple regression an optimal myopic policy is easily tractable. However, for other tasks and with more complex models, such as classification with nonparametric models, the optimal solution is harder to compute. Current approaches make approximations to achieve tractability. We propose an approach that expresses information gain in terms of predictive entropies, and apply this method to the Gaussian Process Classifier (GPC). Our approach makes minimal approximations to the full information theoretic objective. Our experimental performance compares favourably to many popular active learning algorithms, and has equal or lower computational complexity. We compare well to decision theoretic approaches also, which are privy to more information and require much more computational time. Secondly, by developing further a reformulation of binary preference learning to a classification problem, we extend our algorithm to Gaussian Process preference learning.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/27/2022

Characterizing the robustness of Bayesian adaptive experimental designs to active learning bias

Bayesian adaptive experimental design is a form of active learning, whic...
research
06/29/2011

Active Classification: Theory and Application to Underwater Inspection

We discuss the problem in which an autonomous vehicle must classify an o...
research
08/03/2020

OFAI-UKP at HAHA@IberLEF2019: Predicting the Humorousness of Tweets Using Gaussian Process Preference Learning

Most humour processing systems to date make at best discrete, coarse-gra...
research
04/17/2023

Prediction-Oriented Bayesian Active Learning

Information-theoretic approaches to active learning have traditionally f...
research
06/17/2020

GPIRT: A Gaussian Process Model for Item Response Theory

The goal of item response theoretic (IRT) models is to provide estimates...
research
02/22/2011

Predictive Active Set Selection Methods for Gaussian Processes

We propose an active set selection framework for Gaussian process classi...
research
09/07/2018

Information-Theoretic Active Learning for Content-Based Image Retrieval

We propose Information-Theoretic Active Learning (ITAL), a novel batch-m...

Please sign up or login with your details

Forgot password? Click here to reset