Explicit Diffusion of Gaussian Mixture Model Based Image Priors

02/16/2023
by   Martin Zach, et al.
0

In this work we tackle the problem of estimating the density f_X of a random variable X by successive smoothing, such that the smoothed random variable Y fulfills (∂_t - Δ_1)f_Y( · , t) = 0, f_Y( · , 0) = f_X. With a focus on image processing, we propose a product/fields of experts model with Gaussian mixture experts that admits an analytic expression for f_Y ( · , t) under an orthogonality constraint on the filters. This construction naturally allows the model to be trained simultaneously over the entire diffusion horizon using empirical Bayes. We show preliminary results on image denoising where our model leads to competitive results while being tractable, interpretable, and having only a small number of learnable parameters. As a byproduct, our model can be used for reliable noise estimation, allowing blind denoising of images corrupted by heteroscedastic noise.

READ FULL TEXT

page 6

page 7

page 9

page 10

research
02/12/2016

Image Restoration and Reconstruction using Variable Splitting and Class-adapted Image Priors

This paper proposes using a Gaussian mixture model as a prior, for solvi...
research
01/01/2016

Understanding Symmetric Smoothing Filters: A Gaussian Mixture Model Perspective

Many patch-based image denoising algorithms can be formulated as applyin...
research
05/18/2022

Pluralistic Image Completion with Probabilistic Mixture-of-Experts

Pluralistic image completion focuses on generating both visually realist...
research
08/09/2023

Score Priors Guided Deep Variational Inference for Unsupervised Real-World Single Image Denoising

Real-world single image denoising is crucial and practical in computer v...
research
02/08/2017

Scene-adapted plug-and-play algorithm with convergence guarantees

Recent frameworks, such as the so-called plug-and-play, allow us to leve...
research
10/21/2020

Learning Integrodifferential Models for Image Denoising

We introduce an integrodifferential extension of the edge-enhancing anis...
research
06/15/2023

R2-Diff: Denoising by diffusion as a refinement of retrieved motion for image-based motion prediction

Image-based motion prediction is one of the essential techniques for rob...

Please sign up or login with your details

Forgot password? Click here to reset