The probability flow ODE is provably fast

05/19/2023
by   Sitan Chen, et al.
0

We provide the first polynomial-time convergence guarantees for the probability flow ODE implementation (together with a corrector step) of score-based generative modeling. Our analysis is carried out in the wake of recent results obtaining such guarantees for the SDE-based implementation (i.e., denoising diffusion probabilistic modeling or DDPM), but requires the development of novel techniques for studying deterministic dynamics without contractivity. Through the use of a specially chosen corrector step based on the underdamped Langevin diffusion, we obtain better dimension dependence than prior works on DDPM (O(√(d)) vs. O(d), assuming smoothness of the data distribution), highlighting potential advantages of the ODE framework.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/26/2022

Convergence of score-based generative modeling for general data distributions

Score-based generative modeling (SGM) has grown to be a hugely successfu...
research
03/06/2023

Restoration-Degradation Beyond Linear Diffusions: A Non-Asymptotic Analysis For DDIM-Type Samplers

We develop a framework for non-asymptotic analysis of deterministic samp...
research
09/22/2022

Sampling is as easy as learning the score: theory for diffusion models with minimal data assumptions

We provide theoretical convergence guarantees for score-based generative...
research
11/03/2022

Improved Analysis of Score-based Generative Modeling: User-Friendly Bounds under Minimal Smoothness Assumptions

In this paper, we focus on the theoretical analysis of diffusion-based g...
research
06/15/2023

Towards Faster Non-Asymptotic Convergence for Diffusion-Based Generative Models

Diffusion models, which convert noise into new data instances by learnin...
research
06/13/2022

Convergence for score-based generative modeling with polynomial complexity

Score-based generative modeling (SGM) is a highly successful approach fo...
research
05/05/2023

Iterative α-(de)Blending: a Minimalist Deterministic Diffusion Model

We derive a minimalist but powerful deterministic denoising-diffusion mo...

Please sign up or login with your details

Forgot password? Click here to reset