Diffusion Models: A Comprehensive Survey of Methods and Applications

09/02/2022
by   Ling Yang, et al.
257

Diffusion models are a class of deep generative models that have shown impressive results on various tasks with dense theoretical founding. Although diffusion models have achieved impressive quality and diversity of sample synthesis than other state-of-the-art models, they still suffer from costly sampling procedure and sub-optimal likelihood estimation. Recent studies have shown great enthusiasm on improving the performance of diffusion model. In this article, we present a first comprehensive review of existing variants of the diffusion models. Specifically, we provide a first taxonomy of diffusion models and categorize them variants to three types, namely sampling-acceleration enhancement, likelihood-maximization enhancement and data-generalization enhancement. We also introduce in detail other five generative models (i.e., variational autoencoders, generative adversarial networks, normalizing flow, autoregressive models, and energy-based models), and clarify the connections between diffusion models and these generative models. Then we make a thorough investigation into the applications of diffusion models, including computer vision, natural language processing, waveform signal processing, multi-modal modeling, molecular graph generation, time series modeling, and adversarial purification. Furthermore, we propose new perspectives pertaining to the development of this generative model.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/10/2022

Diffusion Models in Vision: A Survey

Denoising diffusion models represent a recent emerging topic in computer...
research
06/07/2023

A Survey on Generative Diffusion Models for Structured Data

In recent years, generative diffusion models have achieved a rapid parad...
research
06/01/2023

On the Equivalence of Consistency-Type Models: Consistency Models, Consistent Diffusion Models, and Fokker-Planck Regularization

The emergence of various notions of “consistency” in diffusion models ha...
research
07/01/2021

Variational Diffusion Models

Diffusion-based generative models have demonstrated a capacity for perce...
research
05/30/2023

One-Line-of-Code Data Mollification Improves Optimization of Likelihood-based Generative Models

Generative Models (GMs) have attracted considerable attention due to the...
research
03/14/2023

Diffusion Models in NLP: A Survey

Diffusion models have become a powerful family of deep generative models...
research
10/26/2022

Full-band General Audio Synthesis with Score-based Diffusion

Recent works have shown the capability of deep generative models to tack...

Please sign up or login with your details

Forgot password? Click here to reset