Reasons for the Superiority of Stochastic Estimators over Deterministic Ones: Robustness, Consistency and Perceptual Quality

11/16/2022
by   Guy Ohayon, et al.
0

Stochastic restoration algorithms allow to explore the space of solutions that correspond to the degraded input. In this paper we reveal additional fundamental advantages of stochastic methods over deterministic ones, which further motivate their use. First, we prove that any restoration algorithm that attains perfect perceptual quality and whose outputs are consistent with the input must be a posterior sampler, and is thus required to be stochastic. Second, we illustrate that while deterministic restoration algorithms may attain high perceptual quality, this can be achieved only by filling up the space of all possible source images using an extremely sensitive mapping, which makes them highly vulnerable to adversarial attacks. Indeed, we show that enforcing deterministic models to be robust to such attacks profoundly hinders their perceptual quality, while robustifying stochastic models hardly influences their perceptual quality, and improves their output variability. These findings provide a motivation to foster progress in stochastic restoration methods, paving the way to better recovery algorithms.

READ FULL TEXT

page 2

page 5

page 19

research
11/21/2022

High-Perceptual Quality JPEG Decoding via Posterior Sampling

JPEG is arguably the most popular image coding format, achieving high co...
research
11/16/2017

The Perception-Distortion Tradeoff

Image restoration algorithms are typically evaluated by some distortion ...
research
06/04/2023

Deep Optimal Transport: A Practical Algorithm for Photo-realistic Image Restoration

We propose an image restoration algorithm that can control the perceptua...
research
02/18/2021

On the advantages of stochastic encoders

Stochastic encoders have been used in rate-distortion theory and neural ...
research
07/20/2023

Physics-Driven Turbulence Image Restoration with Stochastic Refinement

Image distortion by atmospheric turbulence is a stochastic degradation, ...
research
04/01/2019

CFSNet: Toward a Controllable Feature Space for Image Restoration

Deep learning methods have witnessed the great progress in image restora...
research
04/26/2010

An Efficient Watermarking Algorithm to Improve Payload and Robustness without Affecting Image Perceptual Quality

Capacity, Robustness, & Perceptual quality of watermark data are very im...

Please sign up or login with your details

Forgot password? Click here to reset