Transport Gaussian Processes for Regression

01/30/2020
by   Gonzalo Rios, et al.
0

Gaussian process (GP) priors are non-parametric generative models with appealing modelling properties for Bayesian inference: they can model non-linear relationships through noisy observations, have closed-form expressions for training and inference, and are governed by interpretable hyperparameters. However, GP models rely on Gaussianity, an assumption that does not hold in several real-world scenarios, e.g., when observations are bounded or have extreme-value dependencies, a natural phenomenon in physics, finance and social sciences. Although beyond-Gaussian stochastic processes have caught the attention of the GP community, a principled definition and rigorous treatment is still lacking. In this regard, we propose a methodology to construct stochastic processes, which include GPs, warped GPs, Student-t processes and several others under a single unified approach. We also provide formulas and algorithms for training and inference of the proposed models in the regression problem. Our approach is inspired by layers-based models, where each proposed layer changes a specific property over the generated stochastic process. That, in turn, allows us to push-forward a standard Gaussian white noise prior towards other more expressive stochastic processes, for which marginals and copulas need not be Gaussian, while retaining the appealing properties of GPs. We validate the proposed model through experiments with real-world data.

READ FULL TEXT
research
11/03/2020

Transforming Gaussian Processes With Normalizing Flows

Gaussian Processes (GPs) can be used as flexible, non-parametric functio...
research
09/07/2022

Non-Gaussian Process Regression

Standard GPs offer a flexible modelling tool for well-behaved processes....
research
08/29/2018

Physically-inspired Gaussian processes for transcriptional regulation in Drosophila melanogaster

The regulatory process in Drosophila melanogaster is thoroughly studied ...
research
03/19/2018

Learning non-Gaussian Time Series using the Box-Cox Gaussian Process

Gaussian processes (GPs) are Bayesian nonparametric generative models th...
research
09/05/2012

Multiresolution Gaussian Processes

We propose a multiresolution Gaussian process to capture long-range, non...
research
03/14/2023

GaPT: Gaussian Process Toolkit for Online Regression with Application to Learning Quadrotor Dynamics

Gaussian Processes (GPs) are expressive models for capturing signal stat...
research
03/30/2020

Representing Realistic Human Driver Behaviors using a Finite Size Gaussian Process Kernel Bank

The performance of cooperative vehicular applications is tightly depende...

Please sign up or login with your details

Forgot password? Click here to reset