Branched Generative Adversarial Networks for Multi-Scale Image Manifold Learning

03/22/2018
by   Zili Yi, et al.
0

We introduce BranchGAN, a novel training method that enables unconditioned generative adversarial networks (GANs) to learn image manifolds at multiple scales. What is unique about BranchGAN is that it is trained in multiple branches, progressively covering both the breadth and depth of the network, as resolutions of the training images increase to reveal finer-scale features. Specifically, each noise vector, as input to the generator network, is explicitly split into several sub-vectors, each corresponding to and trained to learn image representations at a particular scale. During training, we progressively "de-freeze" the sub-vectors, one at a time, as a new set of higher-resolution images is employed for training and more network layers are added. A consequence of such an explicit sub-vector designation is that we can directly manipulate and even combine latent (sub-vector) codes that are associated with specific feature scales. Experiments demonstrate the effectiveness of our training method in multi-scale, disentangled learning of image manifolds and synthesis, without any extra labels and without compromising quality of the synthesized high-resolution images. We further demonstrate two new applications enabled by BranchGAN.

READ FULL TEXT

page 2

page 7

page 9

page 11

page 12

page 13

page 18

research
03/14/2019

MSG-GAN: Multi-Scale Gradient GAN for Stable Image Synthesis

While Generative Adversarial Networks (GANs) have seen huge successes in...
research
04/05/2022

Arbitrary-Scale Image Synthesis

Positional encodings have enabled recent works to train a single adversa...
research
07/02/2019

Multi-scale GANs for Memory-efficient Generation of High Resolution Medical Images

Currently generative adversarial networks (GANs) are rarely applied to m...
research
10/19/2018

MsCGAN: Multi-scale Conditional Generative Adversarial Networks for Person Image Generation

To synthesize high quality person images with arbitrary poses is challen...
research
05/08/2018

High-resolution medical image synthesis using progressively grown generative adversarial networks

Generative adversarial networks (GANs) are a class of unsupervised machi...
research
03/31/2021

Generating Multi-scale Maps from Remote Sensing Images via Series Generative Adversarial Networks

Considering the success of generative adversarial networks (GANs) for im...
research
11/30/2022

Adaptive adversarial training method for improving multi-scale GAN based on generalization bound theory

In recent years, multi-scale generative adversarial networks (GANs) have...

Please sign up or login with your details

Forgot password? Click here to reset