Diffusion Models: A Comprehensive Survey of Methods and Applications

09/02/2022
by   Ling Yang, et al.
254

Diffusion models are a class of deep generative models that have shown impressive results on various tasks with dense theoretical founding. Although diffusion models have achieved impressive quality and diversity of sample synthesis than other state-of-the-art models, they still suffer from costly sampling procedure and sub-optimal likelihood estimation. Recent studies have shown great enthusiasm on improving the performance of diffusion model. In this article, we present a first comprehensive review of existing variants of the diffusion models. Specifically, we provide a first taxonomy of diffusion models and categorize them variants to three types, namely sampling-acceleration enhancement, likelihood-maximization enhancement and data-generalization enhancement. We also introduce in detail other five generative models (i.e., variational autoencoders, generative adversarial networks, normalizing flow, autoregressive models, and energy-based models), and clarify the connections between diffusion models and these generative models. Then we make a thorough investigation into the applications of diffusion models, including computer vision, natural language processing, waveform signal processing, multi-modal modeling, molecular graph generation, time series modeling, and adversarial purification. Furthermore, we propose new perspectives pertaining to the development of this generative model.

READ FULL TEXT

page 1

page 2

page 3

page 4

09/10/2022

Diffusion Models in Vision: A Survey

Denoising diffusion models represent a recent emerging topic in computer...
03/05/2019

Theoretical guarantees for sampling and inference in generative models with latent diffusions

We introduce and study a class of probabilistic generative models, where...
07/01/2021

Variational Diffusion Models

Diffusion-based generative models have demonstrated a capacity for perce...
08/15/2022

Applying Regularized Schrödinger-Bridge-Based Stochastic Process in Generative Modeling

Compared to the existing function-based models in deep generative modeli...
06/17/2022

A Flexible Diffusion Model

Diffusion (score-based) generative models have been widely used for mode...
07/07/2021

Structured Denoising Diffusion Models in Discrete State-Spaces

Denoising diffusion probabilistic models (DDPMs) (Ho et al. 2020) have s...
07/09/2022

Improving Diffusion Model Efficiency Through Patching

Diffusion models are a powerful class of generative models that iterativ...