SpaceEdit: Learning a Unified Editing Space for Open-Domain Image Editing

11/30/2021
by   Jing Shi, et al.
1

Recently, large pretrained models (e.g., BERT, StyleGAN, CLIP) have shown great knowledge transfer and generalization capability on various downstream tasks within their domains. Inspired by these efforts, in this paper we propose a unified model for open-domain image editing focusing on color and tone adjustment of open-domain images while keeping their original content and structure. Our model learns a unified editing space that is more semantic, intuitive, and easy to manipulate than the operation space (e.g., contrast, brightness, color curve) used in many existing photo editing softwares. Our model belongs to the image-to-image translation framework which consists of an image encoder and decoder, and is trained on pairs of before- and after-images to produce multimodal outputs. We show that by inverting image pairs into latent codes of the learned editing space, our model can be leveraged for various downstream editing tasks such as language-guided image editing, personalized editing, editing-style clustering, retrieval, etc. We extensively study the unique properties of the editing space in experiments and demonstrate superior performance on the aforementioned tasks.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 1

page 14

page 15

page 16

page 17

page 18

page 19

page 20

12/04/2021

SemanticStyleGAN: Learning Compositional Generative Priors for Controllable Image Synthesis and Editing

Recent studies have shown that StyleGANs provide promising prior models ...
11/02/2021

StyleGAN of All Trades: Image Manipulation with Only Pretrained StyleGAN

Recently, StyleGAN has enabled various image manipulation and editing ta...
10/11/2021

LSC-GAN: Latent Style Code Modeling for Continuous Image-to-image Translation

Image-to-image (I2I) translation is usually carried out among discrete d...
06/24/2021

Learning by Planning: Language-Guided Global Image Editing

Recently, language-guided global image editing draws increasing attentio...
09/03/2019

Topologically-Guided Color Image Enhancement

Enhancement is an important step in post-processing digital images for p...
06/03/2020

Nested Scale Editing for Conditional Image Synthesis

We propose an image synthesis approach that provides stratified navigati...
06/14/2021

Automatically eliminating seam lines with Poisson editing in complex relative radiometric normalization mosaicking scenarios

Relative radiometric normalization (RRN) mosaicking among multiple remot...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.