Towards Controllable and Photorealistic Region-wise Image Manipulation

08/19/2021
by   Ansheng You, et al.
5

Adaptive and flexible image editing is a desirable function of modern generative models. In this work, we present a generative model with auto-encoder architecture for per-region style manipulation. We apply a code consistency loss to enforce an explicit disentanglement between content and style latent representations, making the content and style of generated samples consistent with their corresponding content and style references. The model is also constrained by a content alignment loss to ensure the foreground editing will not interfere background contents. As a result, given interested region masks provided by users, our model supports foreground region-wise style transfer. Specially, our model receives no extra annotations such as semantic labels except for self-supervision. Extensive experiments show the effectiveness of the proposed method and exhibit the flexibility of the proposed model for various applications, including region-wise style editing, latent space interpolation, cross-domain style transfer.

READ FULL TEXT

page 1

page 3

page 5

page 6

page 7

page 8

research
04/19/2023

Any-to-Any Style Transfer: Making Picasso and Da Vinci Collaborate

Style transfer aims to render the style of a given image for style refer...
research
03/27/2017

StyleBank: An Explicit Representation for Neural Image Style Transfer

We propose StyleBank, which is composed of multiple convolution filter b...
research
11/21/2022

Exploring the Effectiveness of Mask-Guided Feature Modulation as a Mechanism for Localized Style Editing of Real Images

The success of Deep Generative Models at high-resolution image generatio...
research
07/13/2022

Context-Consistent Semantic Image Editing with Style-Preserved Modulation

Semantic image editing utilizes local semantic label maps to generate th...
research
10/06/2021

Style Equalization: Unsupervised Learning of Controllable Generative Sequence Models

Controllable generative sequence models with the capability to extract a...
research
04/20/2023

Scene Style Text Editing

In this work, we propose a task called "Scene Style Text Editing (SSTE)"...
research
01/25/2018

DeepWriting: Making Digital Ink Editable via Deep Generative Modeling

Digital ink promises to combine the flexibility and aesthetics of handwr...

Please sign up or login with your details

Forgot password? Click here to reset