Structured Graph Variational Autoencoders for Indoor Furniture layout Generation

04/11/2022
by   Aditya Chattopadhyay, et al.
0

We present a structured graph variational autoencoder for generating the layout of indoor 3D scenes. Given the room type (e.g., living room or library) and the room layout (e.g., room elements such as floor and walls), our architecture generates a collection of objects (e.g., furniture items such as sofa, table and chairs) that is consistent with the room type and layout. This is a challenging problem because the generated scene should satisfy multiple constrains, e.g., each object must lie inside the room and two objects cannot occupy the same volume. To address these challenges, we propose a deep generative model that encodes these relationships as soft constraints on an attributed graph (e.g., the nodes capture attributes of room and furniture elements, such as class, pose and size, and the edges capture geometric relationships such as relative orientation). The architecture consists of a graph encoder that maps the input graph to a structured latent space, and a graph decoder that generates a furniture graph, given a latent code and the room graph. The latent space is modeled with auto-regressive priors, which facilitates the generation of highly structured scenes. We also propose an efficient training procedure that combines matching and constrained learning. Experiments on the 3D-FRONT dataset show that our method produces scenes that are diverse and are adapted to the room layout.

READ FULL TEXT

page 4

page 9

page 11

page 25

page 26

research
11/26/2020

Generative Layout Modeling using Constraint Graphs

We propose a new generative model for layout generation. We generate lay...
research
10/27/2022

Layout Aware Inpainting for Automated Furniture Removal in Indoor Scenes

We address the problem of detecting and erasing furniture from a wide an...
research
01/08/2021

Geometry-Based Layout Generation with Hyper-Relations AMONG Objects

Recent studies show increasing demands and interests in automatically ge...
research
12/21/2021

Transferable End-to-end Room Layout Estimation via Implicit Encoding

We study the problem of estimating room layouts from a single panorama i...
research
02/02/2020

Fast 3D Indoor Scene Synthesis with Discrete and Exact Layout Pattern Extraction

We present a fast framework for indoor scene synthesis, given a room geo...
research
12/08/2020

Graph-Based Generative Representation Learning of Semantically and Behaviorally Augmented Floorplans

Floorplans are commonly used to represent the layout of buildings. In co...
research
01/23/2023

LEGO-Net: Learning Regular Rearrangements of Objects in Rooms

Humans universally dislike the task of cleaning up a messy room. If mach...

Please sign up or login with your details

Forgot password? Click here to reset