Classifier-Free Diffusion Guidance

07/26/2022
by   Jonathan Ho, et al.
28

Classifier guidance is a recently introduced method to trade off mode coverage and sample fidelity in conditional diffusion models post training, in the same spirit as low temperature sampling or truncation in other types of generative models. Classifier guidance combines the score estimate of a diffusion model with the gradient of an image classifier and thereby requires training an image classifier separate from the diffusion model. It also raises the question of whether guidance can be performed without a classifier. We show that guidance can be indeed performed by a pure generative model without such a classifier: in what we call classifier-free guidance, we jointly train a conditional and an unconditional diffusion model, and we combine the resulting conditional and unconditional score estimates to attain a trade-off between sample quality and diversity similar to that obtained using classifier guidance.

READ FULL TEXT

page 1

page 6

page 12

page 13

page 14

research
05/11/2021

Diffusion Models Beat GANs on Image Synthesis

We show that diffusion models can achieve image sample quality superior ...
research
12/20/2021

GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Models

Diffusion models have recently been shown to generate high-quality synth...
research
05/31/2022

Improved Vector Quantized Diffusion Models

Vector quantized diffusion (VQ-Diffusion) is a powerful generative model...
research
10/21/2022

Conditional Diffusion with Less Explicit Guidance via Model Predictive Control

How much explicit guidance is necessary for conditional diffusion? We co...
research
08/31/2023

Conditioning Score-Based Generative Models by Neuro-Symbolic Constraints

Score-based and diffusion models have emerged as effective approaches fo...
research
07/04/2023

ProtoDiffusion: Classifier-Free Diffusion Guidance with Prototype Learning

Diffusion models are generative models that have shown significant advan...
research
09/10/2023

Learning Energy-Based Models by Cooperative Diffusion Recovery Likelihood

Training energy-based models (EBMs) with maximum likelihood estimation o...

Please sign up or login with your details

Forgot password? Click here to reset