On The Classification-Distortion-Perception Tradeoff

04/18/2019
by   Dong Liu, et al.
0

Signal degradation is ubiquitous and computational restoration of degraded signal has been investigated for many years. Recently, it is reported that the capability of signal restoration is fundamentally limited by the perception-distortion tradeoff, i.e. the distortion and the perceptual difference between the restored signal and the ideal `original' signal cannot be made both minimal simultaneously. Distortion corresponds to signal fidelity and perceptual difference corresponds to perceptual naturalness, both of which are important metrics in practice. Besides, there is another dimension worthy of consideration, namely the semantic quality or the utility for recognition purpose, of the restored signal. In this paper, we extend the previous perception-distortion tradeoff to the case of classification-distortion-perception (CDP) tradeoff, where we introduced the classification error rate of the restored signal in addition to distortion and perceptual difference. Two versions of the CDP tradeoff are considered, one using a predefined classifier and the other dealing with the optimal classifier for the restored signal. For both versions, we can rigorously prove the existence of the CDP tradeoff, i.e. the distortion, perceptual difference, and classification error rate cannot be made all minimal simultaneously. Our findings can be useful especially for computer vision researches where some low-level vision tasks (signal restoration) serve for high-level vision tasks (visual understanding).

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/24/2018

Introducing the Perception-Distortion Tradeoff into the Rate-Distortion Theory of General Information Sources

Blau and Michaeli recently introduced a novel concept for inverse proble...
research
11/16/2017

The Perception-Distortion Tradeoff

Image restoration algorithms are typically evaluated by some distortion ...
research
01/23/2019

Rethinking Lossy Compression: The Rate-Distortion-Perception Tradeoff

Lossy compression algorithms are typically designed and analyzed through...
research
07/06/2021

A Theory of the Distortion-Perception Tradeoff in Wasserstein Space

The lower the distortion of an estimator, the more the distribution of i...
research
06/18/2021

Universal Rate-Distortion-Perception Representations for Lossy Compression

In the context of lossy compression, Blau Michaeli (2019) adopt a ma...
research
05/24/2020

JPAD-SE: High-Level Semantics for Joint Perception-Accuracy-Distortion Enhancement in Image Compression

While humans can effortlessly transform complex visual scenes into simpl...
research
06/25/2021

Deep Residual Echo Suppression with A Tunable Tradeoff Between Signal Distortion and Echo Suppression

In this paper, we propose a residual echo suppression method using a UNe...

Please sign up or login with your details

Forgot password? Click here to reset