Unsupervised Learning of 3D Structure from Images

07/03/2016
by   Danilo Jimenez Rezende, et al.
0

A key goal of computer vision is to recover the underlying 3D structure from 2D observations of the world. In this paper we learn strong deep generative models of 3D structures, and recover these structures from 3D and 2D images via probabilistic inference. We demonstrate high-quality samples and report log-likelihoods on several datasets, including ShapeNet [2], and establish the first benchmarks in the literature. We also show how these models and their inference networks can be trained end-to-end from 2D images. This demonstrates for the first time the feasibility of learning to infer 3D representations of the world in a purely unsupervised manner.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 5

page 7

page 8

page 13

page 14

page 15

page 16

04/02/2019

HoloGAN: Unsupervised learning of 3D representations from natural images

We propose a novel generative adversarial network (GAN) for the task of ...
10/29/2018

Semi-unsupervised Learning of Human Activity using Deep Generative Models

Here we demonstrate a new deep generative model for classification. We i...
12/15/2020

Unsupervised Learning of Global Factors in Deep Generative Models

We present a novel deep generative model based on non i.i.d. variational...
12/04/2018

Deep Generative Modeling of LiDAR Data

Building models capable of generating structured output is a key challen...
02/23/2018

Longitudinal Face Aging in the Wild - Recent Deep Learning Approaches

Face Aging has raised considerable attentions and interest from the comp...
01/13/2013

Clustering Learning for Robotic Vision

We present the clustering learning technique applied to multi-layer feed...
11/19/2015

Unsupervised Learning of Visual Structure using Predictive Generative Networks

The ability to predict future states of the environment is a central pil...

Code Repositories

Ziv--under-dev

Computer game that visualizes musical components and lyrics of user-chosen song. Unreal Engine 3, Tensorflow, OpenCV, Python


view repo
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.