Score-based Denoising Diffusion with Non-Isotropic Gaussian Noise Models

10/21/2022
by   Vikram Voleti, et al.
0

Generative models based on denoising diffusion techniques have led to an unprecedented increase in the quality and diversity of imagery that is now possible to create with neural generative models. However, most contemporary state-of-the-art methods are derived from a standard isotropic Gaussian formulation. In this work we examine the situation where non-isotropic Gaussian distributions are used. We present the key mathematical derivations for creating denoising diffusion models using an underlying non-isotropic Gaussian noise model. We also provide initial experiments to help verify empirically that this more general modelling approach can also yield high-quality samples.

READ FULL TEXT

page 1

page 13

research
04/12/2023

Diffusion models with location-scale noise

Diffusion Models (DMs) are powerful generative models that add Gaussian ...
research
05/05/2023

Iterative α-(de)Blending: a Minimalist Deterministic Diffusion Model

We derive a minimalist but powerful deterministic denoising-diffusion mo...
research
09/15/2023

Denoising Diffusion Probabilistic Models for Hardware-Impaired Communications

Generative AI has received significant attention among a spectrum of div...
research
09/15/2023

Probabilistic Constellation Shaping With Denoising Diffusion Probabilistic Models: A Novel Approach

With the incredible results achieved from generative pre-trained transfo...
research
12/17/2021

Heavy-tailed denoising score matching

Score-based model research in the last few years has produced state of t...
research
06/17/2022

Lossy Compression with Gaussian Diffusion

We describe a novel lossy compression approach called DiffC which is bas...
research
06/11/2021

PriorGrad: Improving Conditional Denoising Diffusion Models with Data-Driven Adaptive Prior

Denoising diffusion probabilistic models have been recently proposed to ...

Please sign up or login with your details

Forgot password? Click here to reset