High-Resolution Image Editing via Multi-Stage Blended Diffusion

10/24/2022
by   Johannes Ackermann, et al.
0

Diffusion models have shown great results in image generation and in image editing. However, current approaches are limited to low resolutions due to the computational cost of training diffusion models for high-resolution generation. We propose an approach that uses a pre-trained low-resolution diffusion model to edit images in the megapixel range. We first use Blended Diffusion to edit the image at a low resolution, and then upscale it in multiple stages, using a super-resolution model and Blended Diffusion. Using our approach, we achieve higher visual fidelity than by only applying off the shelf super-resolution methods to the output of the diffusion model. We also obtain better global consistency than directly using the diffusion model at a higher resolution.

READ FULL TEXT

page 1

page 2

page 5

page 8

page 9

page 10

page 11

research
07/03/2023

ACDMSR: Accelerated Conditional Diffusion Models for Single Image Super-Resolution

Diffusion models have gained significant popularity in the field of imag...
research
09/03/2023

RSDiff: Remote Sensing Image Generation from Text Using Diffusion Model

Satellite imagery generation and super-resolution are pivotal tasks in r...
research
01/26/2023

simple diffusion: End-to-end diffusion for high resolution images

Currently, applying diffusion models in pixel space of high resolution i...
research
08/03/2022

Pyramidal Denoising Diffusion Probabilistic Models

Diffusion models have demonstrated impressive image generation performan...
research
09/04/2023

Relay Diffusion: Unifying diffusion process across resolutions for image synthesis

Diffusion models achieved great success in image synthesis, but still fa...
research
07/29/2023

RGB-D-Fusion: Image Conditioned Depth Diffusion of Humanoid Subjects

We present RGB-D-Fusion, a multi-modal conditional denoising diffusion p...
research
11/18/2022

Magic3D: High-Resolution Text-to-3D Content Creation

DreamFusion has recently demonstrated the utility of a pre-trained text-...

Please sign up or login with your details

Forgot password? Click here to reset