Imagining the Unseen: Learning a Distribution over Incomplete Images with Dense Latent Trees

08/14/2018
by   Sebastian Kaltwang, et al.
16

Images are composed as a hierarchy of object parts. We use this insight to create a generative graphical model that defines a hierarchical distribution over image parts. Typically, this leads to intractable inference due to loops in the graph. We propose an alternative model structure, the Dense Latent Tree (DLT), which avoids loops and allows for efficient exact inference, while maintaining a dense connectivity between parts of the hierarchy. The usefulness of DLTs is shown for the example task of image completion on partially observed MNIST and Fashion-MNIST data. We verify having successfully learned a hierarchical model of images by visualising its latent states.

READ FULL TEXT

page 8

page 11

page 12

page 13

research
10/21/2019

Generative Hierarchical Models for Parts, Objects, and Scenes

Compositional structures between parts and objects are inherent in natur...
research
03/12/2019

Unsupervised Discovery of Parts, Structure, and Dynamics

Humans easily recognize object parts and their hierarchical structure by...
research
05/10/2013

Beyond Physical Connections: Tree Models in Human Pose Estimation

Simple tree models for articulated objects prevails in the last decade. ...
research
04/05/2022

LatentGAN Autoencoder: Learning Disentangled Latent Distribution

In autoencoder, the encoder generally approximates the latent distributi...
research
02/04/2018

Hierarchical Adversarially Learned Inference

We propose a novel hierarchical generative model with a simple Markovian...
research
06/16/2022

Recursive Neural Programs: Variational Learning of Image Grammars and Part-Whole Hierarchies

Human vision involves parsing and representing objects and scenes using ...
research
01/31/2020

Additive Tree Ensembles: Reasoning About Potential Instances

Imagine being able to ask questions to a black box model such as "Which ...

Please sign up or login with your details

Forgot password? Click here to reset