SEAN: Image Synthesis with Semantic Region-Adaptive Normalization

by   Peihao Zhu, et al.

We propose semantic region-adaptive normalization (SEAN), a simple but effective building block for Generative Adversarial Networks conditioned on segmentation masks that describe the semantic regions in the desired output image. Using SEAN normalization, we can build a network architecture that can control the style of each semantic region individually, e.g., we can specify one style reference image per region. SEAN is better suited to encode, transfer, and synthesize style than the best previous method in terms of reconstruction quality, variability, and visual quality. We evaluate SEAN on multiple datasets and report better quantitative metrics (e.g. FID, PSNR) than the current state of the art. SEAN also pushes the frontier of interactive image editing. We can interactively edit images by changing segmentation masks or the style for any given region. We can also interpolate styles from two reference images per region.


page 1

page 7

page 13

page 14

page 15

page 16

page 17

page 18


Translate the Facial Regions You Like Using Region-Wise Normalization

Though GAN (Generative Adversarial Networks) based technique has greatly...

Context-Consistent Semantic Image Editing with Style-Preserved Modulation

Semantic image editing utilizes local semantic label maps to generate th...

Semi-supervised Synthesis of High-Resolution Editable Textures for 3D Humans

We introduce a novel approach to generate diverse high fidelity texture ...

Collaging on Internal Representations: An Intuitive Approach for Semantic Transfiguration

We present a novel CNN-based image editing method that allows the user t...

MixSyn: Learning Composition and Style for Multi-Source Image Synthesis

Synthetic images created by generative models increase in quality and ex...

Towards Full-to-Empty Room Generation with Structure-Aware Feature Encoding and Soft Semantic Region-Adaptive Normalization

The task of transforming a furnished room image into a background-only i...

Self-normalized Classification of Parkinson's Disease DaTscan Images

Classifying SPECT images requires a preprocessing step which normalizes ...

Code Repositories


SEAN: Image Synthesis with Semantic Region-Adaptive Normalization (CVPR 2020, Oral)

view repo