Multi-Class Gaussian Process Classification Made Conjugate: Efficient Inference via Data Augmentation

05/23/2019
by   Theo Galy-Fajou, et al.
6

We propose a new scalable multi-class Gaussian process classification approach building on a novel modified softmax likelihood function. The new likelihood has two benefits: it leads to well-calibrated uncertainty estimates and allows for an efficient latent variable augmentation. The augmented model has the advantage that it is conditionally conjugate leading to a fast variational inference method via block coordinate ascent updates. Previous approaches suffered from a trade-off between uncertainty calibration and speed. Our experiments show that our method leads to well-calibrated uncertainty estimates and competitive predictive performance while being up to two orders faster than the state of the art.

READ FULL TEXT

page 2

page 3

page 4

page 5

page 6

page 9

page 10

page 12

research
02/26/2020

Automated Augmented Conjugate Inference for Non-conjugate Gaussian Process Models

We propose automated augmented conjugate inference, a new inference meth...
research
10/14/2020

Exploring the Uncertainty Properties of Neural Networks' Implicit Priors in the Infinite-Width Limit

Modern deep learning models have achieved great success in predictive ac...
research
11/19/2018

Mixed Likelihood Gaussian Process Latent Variable Model

We present the Mixed Likelihood Gaussian process latent variable model (...
research
02/18/2018

Efficient Gaussian Process Classification Using Polya-Gamma Data Augmentation

We propose an efficient stochastic variational approach to GP classifica...
research
11/23/2021

Weight Pruning and Uncertainty in Radio Galaxy Classification

In this work we use variational inference to quantify the degree of epis...
research
06/22/2017

Scalable Multi-Class Gaussian Process Classification using Expectation Propagation

This paper describes an expectation propagation (EP) method for multi-cl...
research
03/15/2023

Efficient Uncertainty Estimation with Gaussian Process for Reliable Dialog Response Retrieval

Deep neural networks have achieved remarkable performance in retrieval-b...

Please sign up or login with your details

Forgot password? Click here to reset