Diffusion Models Beat GANs on Image Synthesis

05/11/2021
by   Prafulla Dhariwal, et al.
13

We show that diffusion models can achieve image sample quality superior to the current state-of-the-art generative models. We achieve this on unconditional image synthesis by finding a better architecture through a series of ablations. For conditional image synthesis, we further improve sample quality with classifier guidance: a simple, compute-efficient method for trading off diversity for fidelity using gradients from a classifier. We achieve an FID of 2.97 on ImageNet 128×128, 4.59 on ImageNet 256×256, and 7.72 on ImageNet 512×512, and we match BigGAN-deep even with as few as 25 forward passes per sample, all while maintaining better coverage of the distribution. Finally, we find that classifier guidance combines well with upsampling diffusion models, further improving FID to 3.94 on ImageNet 256×256 and 3.85 on ImageNet 512×512. We release our code at https://github.com/openai/guided-diffusion

READ FULL TEXT

page 21

page 28

page 29

page 30

page 31

page 32

page 34

page 35

research
07/26/2022

Classifier-Free Diffusion Guidance

Classifier guidance is a recently introduced method to trade off mode co...
research
02/18/2021

Improved Denoising Diffusion Probabilistic Models

Denoising diffusion probabilistic models (DDPM) are a class of generativ...
research
08/18/2022

Enhancing Diffusion-Based Image Synthesis with Robust Classifier Guidance

Denoising diffusion probabilistic models (DDPMs) are a recent family of ...
research
03/03/2023

Generative Diffusions in Augmented Spaces: A Complete Recipe

Score-based Generative Models (SGMs) have achieved state-of-the-art synt...
research
06/29/2023

Filtered-Guided Diffusion: Fast Filter Guidance for Black-Box Diffusion Models

Recent advances in diffusion-based generative models have shown incredib...
research
09/23/2022

MAGIC: Mask-Guided Image Synthesis by Inverting a Quasi-Robust Classifier

We offer a method for one-shot image synthesis that allows controlling m...
research
05/31/2022

Improved Vector Quantized Diffusion Models

Vector quantized diffusion (VQ-Diffusion) is a powerful generative model...

Please sign up or login with your details

Forgot password? Click here to reset