Denoising Diffusion Probabilistic Models

06/19/2020
by   Jonathan Ho, et al.
7

We present high quality image synthesis results using diffusion probabilistic models, a class of latent variable models inspired by considerations from nonequilibrium thermodynamics. Our best results are obtained by training on a weighted variational bound designed according to a novel connection between diffusion probabilistic models and denoising score matching with Langevin dynamics, and our models naturally admit a progressive lossy decompression scheme that can be interpreted as a generalization of autoregressive decoding. On the unconditional CIFAR10 dataset, we obtain an Inception score of 9.46 and a state-of-the-art FID score of 3.17. On 256x256 LSUN, we obtain sample quality similar to ProgressiveGAN. Our implementation is available at https://github.com/hojonathanho/diffusion

READ FULL TEXT

page 16

page 17

page 18

page 19

page 21

page 22

page 23

page 24

02/18/2021

Improved Denoising Diffusion Probabilistic Models

Denoising diffusion probabilistic models (DDPM) are a class of generativ...
01/28/2021

Autoregressive Denoising Diffusion Models for Multivariate Probabilistic Time Series Forecasting

In this work, we propose TimeGrad, an autoregressive model for multivari...
12/14/2021

Score-Based Generative Modeling with Critically-Damped Langevin Diffusion

Score-based generative models (SGMs) have demonstrated remarkable synthe...
06/11/2022

gDDIM: Generalized denoising diffusion implicit models

Our goal is to extend the denoising diffusion implicit model (DDIM) to g...
02/20/2022

Pseudo Numerical Methods for Diffusion Models on Manifolds

Denoising Diffusion Probabilistic Models (DDPMs) can generate high-quali...
05/13/2021

Grad-TTS: A Diffusion Probabilistic Model for Text-to-Speech

Recently, denoising diffusion probabilistic models and generative score ...
07/16/2021

Beyond In-Place Corruption: Insertion and Deletion In Denoising Probabilistic Models

Denoising diffusion probabilistic models (DDPMs) have shown impressive r...

Code Repositories

diffusion

Denoising Diffusion Probabilistic Models


view repo

denoising-diffusion-pytorch

Implementation of Denoising Diffusion Probabilistic Model in Pytorch


view repo

ddpm-proteins

A denoising diffusion probabilistic model (DDPM) tailored for conditional generation of protein distograms


view repo

diffusion_models

A series of tutorial notebooks on denoising diffusion probabilistic models in PyTorch


view repo

denoising_diffusion

Unofficial Implementation of "Denoising Diffusion Probabilistic Models" in PyTorch(Lightning)


view repo