A Kernel Approach to Tractable Bayesian Nonparametrics

03/09/2011
by   Ferenc Huszár, et al.
0

Inference in popular nonparametric Bayesian models typically relies on sampling or other approximations. This paper presents a general methodology for constructing novel tractable nonparametric Bayesian methods by applying the kernel trick to inference in a parametric Bayesian model. For example, Gaussian process regression can be derived this way from Bayesian linear regression. Despite the success of the Gaussian process framework, the kernel trick is rarely explicitly considered in the Bayesian literature. In this paper, we aim to fill this gap and demonstrate the potential of applying the kernel trick to tractable Bayesian parametric models in a wider context than just regression. As an example, we present an intuitive Bayesian kernel machine for density estimation that is obtained by applying the kernel trick to a Gaussian generative model in feature space.

READ FULL TEXT

page 5

page 8

research
05/29/2019

Efficient EM-Variational Inference for Hawkes Process

In classical Hawkes process, the baseline intensity and triggering kerne...
research
12/30/2013

Bayesian Models of Graphs, Arrays and Other Exchangeable Random Structures

The natural habitat of most Bayesian methods is data represented by exch...
research
10/24/2011

Multiple Gaussian Process Models

We consider a Gaussian process formulation of the multiple kernel learni...
research
07/03/2019

Unscented Gaussian Process Latent Variable Model: learning from uncertain inputs with intractable kernels

The Gaussian Process (GP) framework flexibility has enabled its use in s...
research
06/13/2022

Density Estimation with Autoregressive Bayesian Predictives

Bayesian methods are a popular choice for statistical inference in small...
research
09/07/2022

Bayesian learning of feature spaces for multitasks problems

This paper presents a Bayesian framework to construct non-linear, parsim...
research
08/19/2020

Improving predictions of Bayesian neural networks via local linearization

In this paper we argue that in Bayesian deep learning, the frequently ut...

Please sign up or login with your details

Forgot password? Click here to reset