Negative-prompt Inversion: Fast Image Inversion for Editing with Text-guided Diffusion Models

05/26/2023
by   Daiki Miyake, et al.
0

In image editing employing diffusion models, it is crucial to preserve the reconstruction quality of the original image while changing its style. Although existing methods ensure reconstruction quality through optimization, a drawback of these is the significant amount of time required for optimization. In this paper, we propose negative-prompt inversion, a method capable of achieving equivalent reconstruction solely through forward propagation without optimization, thereby enabling much faster editing processes. We experimentally demonstrate that the reconstruction quality of our method is comparable to that of existing methods, allowing for inversion at a resolution of 512 pixels and with 50 sampling steps within approximately 5 seconds, which is more than 30 times faster than null-text inversion. Reduction of the computation time by the proposed method further allows us to use a larger number of sampling steps in diffusion models to improve the reconstruction quality with a moderate increase in computation time.

READ FULL TEXT

page 2

page 7

page 8

page 9

page 18

page 19

page 21

page 22

research
06/08/2023

Improving Negative-Prompt Inversion via Proximal Guidance

DDIM inversion has revealed the remarkable potential of real image editi...
research
04/15/2021

A Simple Baseline for StyleGAN Inversion

This paper studies the problem of StyleGAN inversion, which plays an ess...
research
09/10/2023

Effective Real Image Editing with Accelerated Iterative Diffusion Inversion

Despite all recent progress, it is still challenging to edit and manipul...
research
11/15/2022

Direct Inversion: Optimization-Free Text-Driven Real Image Editing with Diffusion Models

With the rise of large, publicly-available text-to-image diffusion model...
research
04/10/2023

Towards Real-time Text-driven Image Manipulation with Unconditional Diffusion Models

Recent advances in diffusion models enable many powerful instruments for...
research
11/06/2020

(Quasi-)Real-Time Inversion of Airborne Time-Domain Electromagnetic Data via Artificial Neural Network

The possibility to have results very quickly after, or even during, the ...
research
04/12/2023

An Edit Friendly DDPM Noise Space: Inversion and Manipulations

Denoising diffusion probabilistic models (DDPMs) employ a sequence of wh...

Please sign up or login with your details

Forgot password? Click here to reset