GenScan: A Generative Method for Populating Parametric 3D Scan Datasets

12/07/2020
by   Mohammad Keshavarzi, et al.
9

The availability of rich 3D datasets corresponding to the geometrical complexity of the built environments is considered an ongoing challenge for 3D deep learning methodologies. To address this challenge, we introduce GenScan, a generative system that populates synthetic 3D scan datasets in a parametric fashion. The system takes an existing captured 3D scan as an input and outputs alternative variations of the building layout including walls, doors, and furniture with corresponding textures. GenScan is a fully automated system that can also be manually controlled by a user through an assigned user interface. Our proposed system utilizes a combination of a hybrid deep neural network and a parametrizer module to extract and transform elements of a given 3D scan. GenScan takes advantage of style transfer techniques to generate new textures for the generated scenes. We believe our system would facilitate data augmentation to expand the currently limited 3D geometry datasets commonly used in 3D computer vision, generative design, and general 3D deep learning tasks.

READ FULL TEXT

page 1

page 5

page 6

page 7

page 8

research
09/01/2020

SketchOpt: Sketch-based Parametric Model Retrieval for Generative Design

Developing fully parametric building models for performance-based genera...
research
03/30/2018

Learning Beyond Human Expertise with Generative Models for Dental Restorations

Computer vision has advanced significantly that many discriminative appr...
research
06/05/2019

Efficient, Lexicon-Free OCR using Deep Learning

Contrary to popular belief, Optical Character Recognition (OCR) remains ...
research
11/06/2021

Generation of microbial colonies dataset with deep learning style transfer

We introduce an effective strategy to generate a synthetic dataset of mi...
research
09/16/2021

Torch.manual_seed(3407) is all you need: On the influence of random seeds in deep learning architectures for computer vision

In this paper I investigate the effect of random seed selection on the a...
research
01/19/2019

Synthesizing facial photometries and corresponding geometries using generative adversarial networks

Artificial data synthesis is currently a well studied topic with useful ...
research
02/23/2016

Exploring the Neural Algorithm of Artistic Style

We explore the method of style transfer presented in the article "A Neur...

Please sign up or login with your details

Forgot password? Click here to reset