Leveraging Probabilistic Circuits for Nonparametric Multi-Output Regression

06/16/2021
by   Zhongjie Yu, et al.
8

Inspired by recent advances in the field of expert-based approximations of Gaussian processes (GPs), we present an expert-based approach to large-scale multi-output regression using single-output GP experts. Employing a deeply structured mixture of single-output GPs encoded via a probabilistic circuit allows us to capture correlations between multiple output dimensions accurately. By recursively partitioning the covariate space and the output space, posterior inference in our model reduces to inference on single-output GP experts, which only need to be conditioned on a small subset of the observations. We show that inference can be performed exactly and efficiently in our model, that it can capture correlations between output dimensions and, hence, often outperforms approaches that do not incorporate inter-output correlations, as demonstrated on several data sets in terms of the negative log predictive density.

READ FULL TEXT
research
06/10/2021

Learning Nonparametric Volterra Kernels with Gaussian Processes

This paper introduces a method for the nonparametric Bayesian learning o...
research
10/10/2019

Deep Structured Mixtures of Gaussian Processes

Gaussian Processes (GPs) are powerful non-parametric Bayesian regression...
research
09/12/2018

Learning Deep Mixtures of Gaussian Process Experts Using Sum-Product Networks

While Gaussian processes (GPs) are the method of choice for regression t...
research
06/17/2022

Shallow and Deep Nonparametric Convolutions for Gaussian Processes

A key challenge in the practical application of Gaussian processes (GPs)...
research
02/14/2021

Healing Products of Gaussian Processes

Gaussian processes (GPs) are nonparametric Bayesian models that have bee...
research
05/03/2022

Bézier Curve Gaussian Processes

Probabilistic models for sequential data are the basis for a variety of ...
research
05/27/2020

Precision Aggregated Local Models

Large scale Gaussian process (GP) regression is infeasible for larger da...

Please sign up or login with your details

Forgot password? Click here to reset