CoralStyleCLIP: Co-optimized Region and Layer Selection for Image Editing

03/09/2023
by   Ambareesh Revanur, et al.
0

Edit fidelity is a significant issue in open-world controllable generative image editing. Recently, CLIP-based approaches have traded off simplicity to alleviate these problems by introducing spatial attention in a handpicked layer of a StyleGAN. In this paper, we propose CoralStyleCLIP, which incorporates a multi-layer attention-guided blending strategy in the feature space of StyleGAN2 for obtaining high-fidelity edits. We propose multiple forms of our co-optimized region and layer selection strategy to demonstrate the variation of time complexity with the quality of edits over different architectural intricacies while preserving simplicity. We conduct extensive experimental analysis and benchmark our method against state-of-the-art CLIP-based methods. Our findings suggest that CoralStyleCLIP results in high-quality edits while preserving the ease of use.

READ FULL TEXT

page 1

page 6

page 7

page 11

page 13

page 14

page 15

page 16

research
08/28/2023

MagicEdit: High-Fidelity and Temporally Coherent Video Editing

In this report, we present MagicEdit, a surprisingly simple yet effectiv...
research
04/15/2021

A Simple Baseline for StyleGAN Inversion

This paper studies the problem of StyleGAN inversion, which plays an ess...
research
11/23/2022

Paint by Example: Exemplar-based Image Editing with Diffusion Models

Language-guided image editing has achieved great success recently. In th...
research
12/07/2022

NeRFEditor: Differentiable Style Decomposition for Full 3D Scene Editing

We present NeRFEditor, an efficient learning framework for 3D scene edit...
research
05/13/2021

Editing Conditional Radiance Fields

A neural radiance field (NeRF) is a scene model supporting high-quality ...
research
10/05/2021

Neural Pitch-Shifting and Time-Stretching with Controllable LPCNet

Modifying the pitch and timing of an audio signal are fundamental audio ...
research
03/18/2018

Ratio-Preserving Half-Cylindrical Warps for Natural Image Stitching

A novel warp for natural image stitching is proposed that utilizes the p...

Please sign up or login with your details

Forgot password? Click here to reset