Neural Variational Inference and Learning in Undirected Graphical Models

11/07/2017
by   Volodymyr Kuleshov, et al.
0

Many problems in machine learning are naturally expressed in the language of undirected graphical models. Here, we propose black-box learning and inference algorithms for undirected models that optimize a variational approximation to the log-likelihood of the model. Central to our approach is an upper bound on the log-partition function parametrized by a function q that we express as a flexible neural network. Our bound makes it possible to track the partition function during learning, to speed-up sampling, and to train a broad class of hybrid directed/undirected models via a unified variational inference framework. We empirically demonstrate the effectiveness of our method on several popular generative modeling datasets.

READ FULL TEXT

page 7

page 8

research
02/11/2016

Variational Inference for Sparse and Undirected Models

Undirected graphical models are applied in genomics, protein structure p...
research
06/27/2022

Pen and Paper Exercises in Machine Learning

This is a collection of (mostly) pen-and-paper exercises in machine lear...
research
06/17/2014

Lifted Tree-Reweighted Variational Inference

We analyze variational inference for highly symmetric graphical models s...
research
01/24/2019

Adversarial Variational Inference and Learning in Markov Random Fields

Markov random fields (MRFs) find applications in a variety of machine le...
research
06/14/2019

Amortized Bethe Free Energy Minimization for Learning MRFs

We propose to learn deep undirected graphical models (i.e., MRFs), with ...
research
05/27/2019

Intervention in undirected Ising graphs and the partition function

Undirected graphical models have many applications in such areas as mach...
research
03/15/2017

A New Unbiased and Efficient Class of LSH-Based Samplers and Estimators for Partition Function Computation in Log-Linear Models

Log-linear models are arguably the most successful class of graphical mo...

Please sign up or login with your details

Forgot password? Click here to reset