Collapse Resistant Deep Convolutional GAN for Multi-Object Image Generation

11/08/2019
by   Elijah D. Bolluyt, et al.
0

This work introduces a novel system for the generation of images that contain multiple classes of objects. Recent work in Generative Adversarial Networks have produced high quality images, but many focus on generating images of a single object or set of objects. Our system addresses the task of image generation conditioned on a list of desired classes to be included in a single image. This enables our system to generate images with any given combination of objects, all composed into a visually realistic natural image. The system learns the interrelationships of all classes represented in a dataset, and can generate diverse samples including a set of these classes. It displays the ability to arrange these objects together, accounting for occlusions and inter-object spatial relations that characterize complex natural images. To accomplish this, we introduce a novel architecture based on Conditional Deep Convolutional GANs that is stabilized against collapse relative to both mode and condition. The system learns to rectify mode collapse during training, self-correcting to avoid suboptimal generation modes.

READ FULL TEXT

page 4

page 5

research
03/05/2017

LR-GAN: Layered Recursive Generative Adversarial Networks for Image Generation

We present LR-GAN: an adversarial image generation model which takes sce...
research
03/31/2021

Multi-Class Multi-Instance Count Conditioned Adversarial Image Generation

Image generation has rapidly evolved in recent years. Modern architectur...
research
06/24/2020

Deep Convolutional GANs for Car Image Generation

In this paper, we investigate the application of deep convolutional GANs...
research
09/25/2019

Conditional Transferring Features: Scaling GANs to Thousands of Classes with 30

Generative adversarial network (GAN) has greatly improved the quality of...
research
01/17/2022

Can We Find Neurons that Cause Unrealistic Images in Deep Generative Networks?

Even though image generation with Generative Adversarial Networks has be...
research
04/08/2020

Leveraging 2D Data to Learn Textured 3D Mesh Generation

Numerous methods have been proposed for probabilistic generative modelli...
research
06/22/2020

generating annotated high-fidelity images containing multiple coherent objects

Recent developments related to generative models have made it possible t...

Please sign up or login with your details

Forgot password? Click here to reset