Image Generators with Conditionally-Independent Pixel Synthesis

11/27/2020
by   Ivan Anokhin, et al.
0

Existing image generator networks rely heavily on spatial convolutions and, optionally, self-attention blocks in order to gradually synthesize images in a coarse-to-fine manner. Here, we present a new architecture for image generators, where the color value at each pixel is computed independently given the value of a random latent vector and the coordinate of that pixel. No spatial convolutions or similar operations that propagate information across pixels are involved during the synthesis. We analyze the modeling capabilities of such generators when trained in an adversarial fashion, and observe the new generators to achieve similar generation quality to state-of-the-art convolutional generators. We also investigate several interesting properties unique to the new architecture.

READ FULL TEXT

page 1

page 5

page 6

page 7

page 8

page 13

page 14

page 15

research
03/24/2023

Efficient Scale-Invariant Generator with Column-Row Entangled Pixel Synthesis

Any-scale image synthesis offers an efficient and scalable solution to s...
research
10/19/2021

CIPS-3D: A 3D-Aware Generator of GANs Based on Conditionally-Independent Pixel Synthesis

The style-based GAN (StyleGAN) architecture achieved state-of-the-art re...
research
04/01/2021

Improved Image Generation via Sparse Modeling

The interest of the deep learning community in image synthesis has grown...
research
03/06/2023

MotionVideoGAN: A Novel Video Generator Based on the Motion Space Learned from Image Pairs

Video generation has achieved rapid progress benefiting from high-qualit...
research
11/05/2021

Improving Visual Quality of Image Synthesis by A Token-based Generator with Transformers

We present a new perspective of achieving image synthesis by viewing thi...
research
01/22/2020

Graph Generators: State of the Art and Open Challenges

The abundance of interconnected data has fueled the design and implement...
research
01/20/2010

Spatial Domain Watermarking Scheme for Colored Images Based on Log-average Luminance

In this paper a new watermarking scheme is presented based on log-averag...

Please sign up or login with your details

Forgot password? Click here to reset