Diverse Image Synthesis from Semantic Layouts via Conditional IMLE

11/29/2018
by   Ke Li, et al.
16

Most existing methods for conditional image synthesis are only able to generate a single plausible image for any given input, or at best a fixed number of plausible images. In this paper, we focus on the problem of generating images from semantic segmentation maps and present a simple new method that can generate an arbitrary number of images with diverse appearance for the same semantic layout. Unlike most existing approaches which adopt the GAN framework, our method is based on the recently introduced Implicit Maximum Likelihood Estimation framework. Compared to the leading approach, our method is able to generate more diverse images while producing fewer artifacts despite using the same architecture. The learned latent space also has sensible structure despite the lack of supervision that encourages such behaviour.

READ FULL TEXT

page 5

page 6

page 7

page 11

page 12

page 13

page 14

page 15

research
04/07/2020

Multimodal Image Synthesis with Conditional Implicit Maximum Likelihood Estimation

Many tasks in computer vision and graphics fall within the framework of ...
research
03/11/2019

Pluralistic Image Completion

Most image completion methods produce only one result for each masked in...
research
11/25/2022

CHIMLE: Conditional Hierarchical IMLE for Multimodal Conditional Image Synthesis

A persistent challenge in conditional image synthesis has been to genera...
research
06/16/2021

Cascading Modular Network (CAM-Net) for Multimodal Image Synthesis

Deep generative models such as GANs have driven impressive advances in c...
research
06/25/2021

Diversifying Semantic Image Synthesis and Editing via Class- and Layer-wise VAEs

Semantic image synthesis is a process for generating photorealistic imag...
research
09/06/2018

Structural Consistency and Controllability for Diverse Colorization

Colorizing a given gray-level image is an important task in the media an...
research
06/02/2021

Barbershop: GAN-based Image Compositing using Segmentation Masks

Seamlessly blending features from multiple images is extremely challengi...

Please sign up or login with your details

Forgot password? Click here to reset