Image Synthesis via Semantic Composition

09/15/2021
by   Yi Wang, et al.
0

In this paper, we present a novel approach to synthesize realistic images based on their semantic layouts. It hypothesizes that for objects with similar appearance, they share similar representation. Our method establishes dependencies between regions according to their appearance correlation, yielding both spatially variant and associated representations. Conditioning on these features, we propose a dynamic weighted network constructed by spatially conditional computation (with both convolution and normalization). More than preserving semantic distinctions, the given dynamic network strengthens semantic relevance, benefiting global structure and detail synthesis. We demonstrate that our method gives the compelling generation performance qualitatively and quantitatively with extensive experiments on benchmarks.

READ FULL TEXT

page 1

page 3

page 4

page 7

page 8

page 12

page 13

research
12/08/2020

Efficient Semantic Image Synthesis via Class-Adaptive Normalization

Spatially-adaptive normalization (SPADE) is remarkably successful recent...
research
04/06/2020

Rethinking Spatially-Adaptive Normalization

Spatially-adaptive normalization is remarkably successful recently in co...
research
05/12/2019

Adaptive Composition GAN towards Realistic Image Synthesis

Despite the rapid progress of generative adversarial networks (GANs) in ...
research
06/30/2022

Semantic Image Synthesis via Diffusion Models

Denoising Diffusion Probabilistic Models (DDPMs) have achieved remarkabl...
research
08/14/2023

Semantic-aware Network for Aerial-to-Ground Image Synthesis

Aerial-to-ground image synthesis is an emerging and challenging problem ...
research
04/08/2020

Attentive Normalization for Conditional Image Generation

Traditional convolution-based generative adversarial networks synthesize...
research
04/29/2018

Semi-parametric Image Synthesis

We present a semi-parametric approach to photographic image synthesis fr...

Please sign up or login with your details

Forgot password? Click here to reset