Auto-Encoding Progressive Generative Adversarial Networks For 3D Multi Object Scenes

03/08/2019
by   Vedant Singh, et al.
0

3D multi object generative models allow us to synthesize a large range of novel 3D multi object scenes and also identify objects, shapes, layouts and their positions. But multi object scenes are difficult to create because of the dataset being multimodal in nature. The conventional 3D generative adversarial models are not efficient in generating multi object scenes, they usually tend to generate either one object or generate fuzzy results of multiple objects. Auto-encoder models have much scope in feature extraction and representation learning using the unsupervised paradigm in probabilistic spaces. We try to make use of this property in our proposed model. In this paper we propose a novel architecture using 3DConvNets trained with the progressive training paradigm that has been able to generate realistic high resolution 3D scenes of rooms, bedrooms, offices etc. with various pieces of furniture and objects. We make use of the adversarial auto-encoder along with the WGAN-GP loss parameter in our discriminator loss function. Finally this new approach to multi object scene generation has also been able to generate more number of objects per scene.

READ FULL TEXT

page 3

page 4

research
12/10/2019

Learning to generate new indoor scenes

Deep generative models have been used in recent years to learn coherent ...
research
06/12/2016

Human Centred Object Co-Segmentation

Co-segmentation is the automatic extraction of the common semantic regio...
research
06/15/2023

Improving Path Planning Performance through Multimodal Generative Models with Local Critics

This paper presents a novel method for accelerating path planning tasks ...
research
04/03/2020

Disassembling Object Representations without Labels

In this paper, we study a new representation-learning task, which we ter...
research
02/19/2020

Table-Top Scene Analysis Using Knowledge-Supervised MCMC

In this paper, we propose a probabilistic method to generate abstract sc...
research
04/10/2019

Predicting Novel Views Using Generative Adversarial Query Network

The problem of predicting a novel view of the scene using an arbitrary n...
research
06/08/2021

Property-Aware Robot Object Manipulation: a Generative Approach

When transporting an object, we unconsciously adapt our movement to its ...

Please sign up or login with your details

Forgot password? Click here to reset