Compositionally-Warped Gaussian Processes

06/23/2019
by   Felipe Tobar, et al.
0

The Gaussian process (GP) is a nonparametric prior distribution over functions indexed by time, space, or other high-dimensional index set. The GP is a flexible model yet its limitation is given by its very nature: it can only model Gaussian marginal distributions. To model non-Gaussian data, a GP can be warped by a nonlinear transformation (or warping) as performed by warped GPs (WGPs) and more computationally-demanding alternatives such as Bayesian WGPs and deep GPs. However, the WGP requires a numerical approximation of the inverse warping for prediction, which increases the computational complexity in practice. To sidestep this issue, we construct a novel class of warpings consisting of compositions of multiple elementary functions, for which the inverse is known explicitly. We then propose the compositionally-warped GP (CWGP), a non-Gaussian generative model whose expressiveness follows from its deep compositional architecture, and its computational efficiency is guaranteed by the analytical inverse warping. Experimental validation using synthetic and real-world datasets confirms that the proposed CWGP is robust to the choice of warpings and provides more accurate point predictions, better trained models and shorter computation times than WGP.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/19/2018

Learning non-Gaussian Time Series using the Box-Cox Gaussian Process

Gaussian processes (GPs) are Bayesian nonparametric generative models th...
research
06/18/2019

Vecchia-Laplace approximations of generalized Gaussian processes for big non-Gaussian spatial data

Generalized Gaussian processes (GGPs) are highly flexible models that co...
research
01/20/2021

A Similarity Measure of Gaussian Process Predictive Distributions

Some scenarios require the computation of a predictive distribution of a...
research
11/26/2018

Sequence Alignment with Dirichlet Process Mixtures

We present a probabilistic model for unsupervised alignment of high-dime...
research
06/09/2023

Response Time Improves Choice Prediction and Function Estimation for Gaussian Process Models of Perception and Preferences

Models for human choice prediction in preference learning and psychophys...
research
07/06/2023

Beyond Intuition, a Framework for Applying GPs to Real-World Data

Gaussian Processes (GPs) offer an attractive method for regression over ...
research
10/11/2022

Computationally-efficient initialisation of GPs: The generalised variogram method

We present a computationally-efficient strategy to find the hyperparamet...

Please sign up or login with your details

Forgot password? Click here to reset