On Analyzing Generative and Denoising Capabilities of Diffusion-based Deep Generative Models

05/31/2022
by   Kamil Deja, et al.
0

Diffusion-based Deep Generative Models (DDGMs) offer state-of-the-art performance in generative modeling. Their main strength comes from their unique setup in which a model (the backward diffusion process) is trained to reverse the forward diffusion process, which gradually adds noise to the input signal. Although DDGMs are well studied, it is still unclear how the small amount of noise is transformed during the backward diffusion process. Here, we focus on analyzing this problem to gain more insight into the behavior of DDGMs and their denoising and generative capabilities. We observe a fluid transition point that changes the functionality of the backward diffusion process from generating a (corrupted) image from noise to denoising the corrupted image to the final sample. Based on this observation, we postulate to divide a DDGM into two parts: a denoiser and a generator. The denoiser could be parameterized by a denoising auto-encoder, while the generator is a diffusion-based model with its own set of parameters. We experimentally validate our proposition, showing its pros and cons.

READ FULL TEXT

page 7

page 9

page 14

page 15

research
09/10/2022

Diffusion Models in Vision: A Survey

Denoising diffusion models represent a recent emerging topic in computer...
research
10/10/2021

Denoising Diffusion Gamma Models

Generative diffusion processes are an emerging and effective tool for im...
research
06/01/2023

Addressing Negative Transfer in Diffusion Models

Diffusion-based generative models have achieved remarkable success in va...
research
12/11/2022

How to Backdoor Diffusion Models?

Diffusion models are state-of-the-art deep learning empowered generative...
research
11/30/2022

Denoising Deep Generative Models

Likelihood-based deep generative models have recently been shown to exhi...
research
09/14/2023

Beta Diffusion

We introduce beta diffusion, a novel generative modeling method that int...
research
10/20/2022

Graphically Structured Diffusion Models

We introduce a framework for automatically defining and learning deep ge...

Please sign up or login with your details

Forgot password? Click here to reset