Interpretable ODE-style Generative Diffusion Model via Force Field Construction

03/14/2023
by   Weiyang Jin, et al.
0

For a considerable time, researchers have focused on developing a method that establishes a deep connection between the generative diffusion model and mathematical physics. Despite previous efforts, progress has been limited to the pursuit of a single specialized method. In order to advance the interpretability of diffusion models and explore new research directions, it is essential to establish a unified ODE-style generative diffusion model. Such a model should draw inspiration from physical models and possess a clear geometric meaning. This paper aims to identify various physical models that are suitable for constructing ODE-style generative diffusion models accurately from a mathematical perspective. We then summarize these models into a unified method. Additionally, we perform a case study where we use the theoretical model identified by our method to develop a range of new diffusion model methods, and conduct experiments. Our experiments on CIFAR-10 demonstrate the effectiveness of our approach. We have constructed a computational framework that attains highly proficient results with regards to image generation speed, alongside an additional model that demonstrates exceptional performance in both Inception score and FID score. These results underscore the significance of our method in advancing the field of diffusion models.

READ FULL TEXT

page 8

page 13

page 14

page 15

page 16

research
02/06/2023

Generative Diffusion Models on Graphs: Methods and Applications

Diffusion models, as a novel generative paradigm, have achieved remarkab...
research
11/26/2021

Conditional Image Generation with Score-Based Diffusion Models

Score-based diffusion models have emerged as one of the most promising f...
research
07/09/2022

Improving Diffusion Model Efficiency Through Patching

Diffusion models are a powerful class of generative models that iterativ...
research
08/16/2022

Your ViT is Secretly a Hybrid Discriminative-Generative Diffusion Model

Diffusion Denoising Probability Models (DDPM) and Vision Transformer (Vi...
research
03/13/2023

Erasing Concepts from Diffusion Models

Motivated by recent advancements in text-to-image diffusion, we study er...
research
05/18/2023

UniControl: A Unified Diffusion Model for Controllable Visual Generation In the Wild

Achieving machine autonomy and human control often represent divergent o...
research
01/07/2012

A United Image Force for Deformable Models and Direct Transforming Geometric Active Contorus to Snakes by Level Sets

A uniform distribution of the image force field around the object fasts ...

Please sign up or login with your details

Forgot password? Click here to reset