GenPhys: From Physical Processes to Generative Models

04/05/2023
by   Ziming Liu, et al.
0

Since diffusion models (DM) and the more recent Poisson flow generative models (PFGM) are inspired by physical processes, it is reasonable to ask: Can physical processes offer additional new generative models? We show that the answer is yes. We introduce a general family, Generative Models from Physical Processes (GenPhys), where we translate partial differential equations (PDEs) describing physical processes to generative models. We show that generative models can be constructed from s-generative PDEs (s for smooth). GenPhys subsume the two existing generative models (DM and PFGM) and even give rise to new families of generative models, e.g., "Yukawa Generative Models" inspired from weak interactions. On the other hand, some physical processes by default do not belong to the GenPhys family, e.g., the wave equation and the Schrödinger equation, but could be made into the GenPhys family with some modifications. Our goal with GenPhys is to explore and expand the design space of generative models.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/26/2023

A mean-field games laboratory for generative modeling

In this paper, we demonstrate the versatility of mean-field games (MFGs)...
research
04/29/2019

Generative models as parsimonious descriptions of sensorimotor loops

The Bayesian brain hypothesis, predictive processing and variational fre...
research
04/15/2023

The Design Space of Generative Models

Card et al.'s classic paper "The Design Space of Input Devices" establis...
research
04/06/2019

Interpolation in generative models

We show how to construct smooth and realistic interpolations for generat...
research
02/08/2023

PFGM++: Unlocking the Potential of Physics-Inspired Generative Models

We introduce a new family of physics-inspired generative models termed P...
research
07/24/2020

Deep Generative Models that Solve PDEs: Distributed Computing for Training Large Data-Free Models

Recent progress in scientific machine learning (SciML) has opened up the...
research
07/29/2023

Fingerprints of Generative Models in the Frequency Domain

It is verified in existing works that CNN-based generative models leave ...

Please sign up or login with your details

Forgot password? Click here to reset