SEAN: Image Synthesis with Semantic Region-Adaptive Normalization

11/28/2019
by   Peihao Zhu, et al.
20

We propose semantic region-adaptive normalization (SEAN), a simple but effective building block for Generative Adversarial Networks conditioned on segmentation masks that describe the semantic regions in the desired output image. Using SEAN normalization, we can build a network architecture that can control the style of each semantic region individually, e.g., we can specify one style reference image per region. SEAN is better suited to encode, transfer, and synthesize style than the best previous method in terms of reconstruction quality, variability, and visual quality. We evaluate SEAN on multiple datasets and report better quantitative metrics (e.g. FID, PSNR) than the current state of the art. SEAN also pushes the frontier of interactive image editing. We can interactively edit images by changing segmentation masks or the style for any given region. We can also interpolate styles from two reference images per region.

READ FULL TEXT

page 1

page 7

page 13

page 14

page 15

page 16

page 17

page 18

07/29/2020

Translate the Facial Regions You Like Using Region-Wise Normalization

Though GAN (Generative Adversarial Networks) based technique has greatly...
07/13/2022

Context-Consistent Semantic Image Editing with Style-Preserved Modulation

Semantic image editing utilizes local semantic label maps to generate th...
03/31/2021

Semi-supervised Synthesis of High-Resolution Editable Textures for 3D Humans

We introduce a novel approach to generate diverse high fidelity texture ...
11/26/2018

Collaging on Internal Representations: An Intuitive Approach for Semantic Transfiguration

We present a novel CNN-based image editing method that allows the user t...
11/24/2021

MixSyn: Learning Composition and Style for Multi-Source Image Synthesis

Synthetic images created by generative models increase in quality and ex...
12/10/2021

Towards Full-to-Empty Room Generation with Structure-Aware Feature Encoding and Soft Semantic Region-Adaptive Normalization

The task of transforming a furnished room image into a background-only i...
12/27/2021

Self-normalized Classification of Parkinson's Disease DaTscan Images

Classifying SPECT images requires a preprocessing step which normalizes ...

Code Repositories

SEAN

SEAN: Image Synthesis with Semantic Region-Adaptive Normalization (CVPR 2020, Oral)


view repo