Denoising Diffusion Probabilistic Models for Robust Image Super-Resolution in the Wild

02/15/2023
by   Hshmat Sahak, et al.
0

Diffusion models have shown promising results on single-image super-resolution and other image- to-image translation tasks. Despite this success, they have not outperformed state-of-the-art GAN models on the more challenging blind super-resolution task, where the input images are out of distribution, with unknown degradations. This paper introduces SR3+, a diffusion-based model for blind super-resolution, establishing a new state-of-the-art. To this end, we advocate self-supervised training with a combination of composite, parameterized degradations for self-supervised training, and noise-conditioing augmentation during training and testing. With these innovations, a large-scale convolutional architecture, and large-scale datasets, SR3+ greatly outperforms SR3. It outperforms Real-ESRGAN when trained on the same data, with a DRealSR FID score of 36.82 vs. 37.22, which further improves to FID of 32.37 with larger models, and further still with larger training sets.

READ FULL TEXT

page 1

page 5

page 8

page 12

page 13

page 14

page 15

page 16

research
07/03/2023

ACDMSR: Accelerated Conditional Diffusion Models for Single Image Super-Resolution

Diffusion models have gained significant popularity in the field of imag...
research
04/30/2021

SRDiff: Single Image Super-Resolution with Diffusion Probabilistic Models

Single image super-resolution (SISR) aims to reconstruct high-resolution...
research
04/15/2021

Image Super-Resolution via Iterative Refinement

We present SR3, an approach to image Super-Resolution via Repeated Refin...
research
03/18/2021

Self-Supervised Adaptation for Video Super-Resolution

Recent single-image super-resolution (SISR) networks, which can adapt th...
research
11/28/2018

Image Reconstruction with Predictive Filter Flow

We propose a simple, interpretable framework for solving a wide range of...
research
12/12/2018

Efficient Super Resolution For Large-Scale Images Using Attentional GAN

Single Image Super Resolution (SISR) is a well-researched problem with b...
research
08/15/2023

YODA: You Only Diffuse Areas. An Area-Masked Diffusion Approach For Image Super-Resolution

This work introduces "You Only Diffuse Areas" (YODA), a novel method for...

Please sign up or login with your details

Forgot password? Click here to reset