A unified framework for closed-form nonparametric regression, classification, preference and mixed problems with Skew Gaussian Processes

12/12/2020
by   Alessio Benavoli, et al.
0

Skew-Gaussian processes (SkewGPs) extend the multivariate Unified Skew-Normal distributions over finite dimensional vectors to distribution over functions. SkewGPs are more general and flexible than Gaussian processes, as SkewGPs may also represent asymmetric distributions. In a recent contribution we showed that SkewGP and probit likelihood are conjugate, which allows us to compute the exact posterior for non-parametric binary classification and preference learning. In this paper, we generalize previous results and we prove that SkewGP is conjugate with both the normal and affine probit likelihood, and more in general, with their product. This allows us to (i) handle classification, preference, numeric and ordinal regression, and mixed problems in a unified framework; (ii) derive closed-form expression for the corresponding posterior distributions. We show empirically that the proposed framework based on SkewGP provides better performance than Gaussian processes in active learning and Bayesian (constrained) optimization. These two tasks are fundamental for design of experiments and in Data Science.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 26

page 27

05/26/2020

Skew Gaussian Processes for Classification

Gaussian processes (GPs) are distributions over functions, which provide...
10/26/2021

Non-Gaussian Gaussian Processes for Few-Shot Regression

Gaussian Processes (GPs) have been widely used in machine learning to mo...
09/22/2020

An Intuitive Tutorial to Gaussian Processes Regression

This introduction aims to provide readers an intuitive understanding of ...
05/28/2020

Data Analysis Recipes: Products of multivariate Gaussians in Bayesian inferences

A product of two Gaussians (or normal distributions) is another Gaussian...
02/21/2020

Efficiently sampling functions from Gaussian process posteriors

Gaussian processes are the gold standard for many real-world modeling pr...
11/22/2021

Transfer Learning with Gaussian Processes for Bayesian Optimization

Bayesian optimization is a powerful paradigm to optimize black-box funct...
06/19/2015

Variational Gaussian Copula Inference

We utilize copulas to constitute a unified framework for constructing an...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.