FrankenGAN: Guided Detail Synthesis for Building Mass-Models Using Style-Synchonized GANs

06/19/2018
by   Tom Kelly, et al.
0

Coarse building mass models are now routinely generated at scales ranging from individual buildings through to whole cities. For example, they can be abstracted from raw measurements, generated procedurally, or created manually. However, these models typically lack any meaningful semantic or texture details, making them unsuitable for direct display. We introduce the problem of automatically and realistically decorating such models by adding semantically consistent geometric details and textures. Building on the recent success of generative adversarial networks (GANs), we propose FrankenGAN, a cascade of GANs to create plausible details across multiple scales over large neighborhoods. The various GANs are synchronized to produce consistent style distributions over buildings and neighborhoods. We provide the user with direct control over the variability of the output. We allow her to interactively specify style via images and manipulate style-adapted sliders to control style variability. We demonstrate our system on several large-scale examples. The generated outputs are qualitatively evaluated via a set of user studies and are found to be realistic, semantically-plausible, and style-consistent.

READ FULL TEXT

page 8

page 11

page 13

page 15

page 16

page 18

page 19

page 20

research
04/29/2019

TileGAN: Synthesis of Large-Scale Non-Homogeneous Textures

We tackle the problem of texture synthesis in the setting where many inp...
research
04/09/2019

User-Controllable Multi-Texture Synthesis with Generative Adversarial Networks

We propose a novel multi-texture synthesis model based on generative adv...
research
05/29/2019

GlyphGAN: Style-Consistent Font Generation Based on Generative Adversarial Networks

In this paper, we propose GlyphGAN: style-consistent font generation bas...
research
10/22/2021

BlendGAN: Implicitly GAN Blending for Arbitrary Stylized Face Generation

Generative Adversarial Networks (GANs) have made a dramatic leap in high...
research
06/04/2019

Example-Guided Style Consistent Image Synthesis from Semantic Labeling

Example-guided image synthesis aims to synthesize an image from a semant...
research
03/30/2023

Semantic Image Translation for Repairing the Texture Defects of Building Models

The accurate representation of 3D building models in urban environments ...
research
12/08/2021

Assessing a Single Image in Reference-Guided Image Synthesis

Assessing the performance of Generative Adversarial Networks (GANs) has ...

Please sign up or login with your details

Forgot password? Click here to reset