Implicit Variational Inference with Kernel Density Ratio Fitting

05/29/2017
by   Jiaxin Shi, et al.
0

Recent progress in variational inference has paid much attention to the flexibility of variational posteriors. Work has been done to use implicit distributions, i.e., distributions without tractable likelihoods as the variational posterior. However, existing methods on implicit posteriors still face challenges of noisy estimation and can hardly scale to high-dimensional latent variable models. In this paper, we present an implicit variational inference approach with kernel density ratio fitting that addresses these challenges. As far as we know, for the first time implicit variational inference is successfully applied to Bayesian neural networks, which shows promising results on both regression and classification tasks.

READ FULL TEXT
research
05/08/2019

Importance Weighted Hierarchical Variational Inference

Variational Inference is a powerful tool in the Bayesian modeling toolki...
research
11/29/2017

On the use of bootstrap with variational inference: Theory, interpretation, and a two-sample test example

Variational inference is a general approach for approximating complex de...
research
06/16/2017

Adversarial Variational Inference for Tweedie Compound Poisson Models

Tweedie Compound Poisson models are heavily used for modelling non-negat...
research
01/18/2018

Overpruning in Variational Bayesian Neural Networks

The motivations for using variational inference (VI) in neural networks ...
research
02/28/2017

Hierarchical Implicit Models and Likelihood-Free Variational Inference

Implicit probabilistic models are a flexible class of models defined by ...
research
10/23/2020

Statistical Guarantees for Transformation Based Models with Applications to Implicit Variational Inference

Transformation-based methods have been an attractive approach in non-par...
research
03/22/2022

Self-Supervised Representation Learning as Multimodal Variational Inference

This paper proposes a probabilistic extension of SimSiam, a recent self-...

Please sign up or login with your details

Forgot password? Click here to reset