DeepAI AI Chat
Log In Sign Up

The Theory and Algorithm of Ergodic Inference

11/17/2018
by   Yichuan Zhang, et al.
0

Approximate inference algorithm is one of the fundamental research fields in machine learning. The two dominant theoretical inference frameworks in machine learning are variational inference (VI) and Markov chain Monte Carlo (MCMC). However, because of the fundamental limitation in the theory, it is very challenging to improve existing VI and MCMC methods on both the computational scalability and statistical efficiency. To overcome this obstacle, we propose a new theoretical inference framework called ergodic Inference based on the fundamental property of ergodic transformations. The key contribution of this work is to establish the theoretical foundation of ergodic inference for the development of practical algorithms in future work.

READ FULL TEXT

page 1

page 2

page 3

page 4

02/27/2020

MetFlow: A New Efficient Method for Bridging the Gap between Markov Chain Monte Carlo and Variational Inference

In this contribution, we propose a new computationally efficient method ...
08/04/2017

Learning Model Reparametrizations: Implicit Variational Inference by Fitting MCMC distributions

We introduce a new algorithm for approximate inference that combines rep...
10/15/2020

Orbital MCMC

Markov Chain Monte Carlo (MCMC) is a computational approach to fundament...
05/31/2022

Variational inference via Wasserstein gradient flows

Along with Markov chain Monte Carlo (MCMC) methods, variational inferenc...
07/08/2020

Deep Fiducial Inference

Since the mid-2000s, there has been a resurrection of interest in modern...
08/07/2020

MCMC Algorithms for Posteriors on Matrix Spaces

We study Markov chain Monte Carlo (MCMC) algorithms for target distribut...
02/27/2011

Instant Replay: Investigating statistical Analysis in Sports

Technology has had an unquestionable impact on the way people watch spor...