Optimal Transport for Unsupervised Restoration Learning

08/04/2021
by   Wei Wang, et al.
0

Recently, much progress has been made in unsupervised restoration learning. However, existing methods more or less rely on some assumptions on the signal and/or degradation model, which limits their practical performance. How to construct an optimal criterion for unsupervised restoration learning without any prior knowledge on the degradation model is still an open question. Toward answering this question, this work proposes a criterion for unsupervised restoration learning based on the optimal transport theory. This criterion has favorable properties, e.g., approximately maximal preservation of the information of the signal, whilst achieving perceptual reconstruction. Furthermore, though a relaxed unconstrained formulation is used in practical implementation, we show that the relaxed formulation in theory has the same solution as the original constrained formulation. Experiments on synthetic and real-world data, including realistic photographic, microscopy, depth, and raw depth images, demonstrate that the proposed method even compares favorably with supervised methods, e.g., approaching the PSNR of supervised methods while having better perceptual quality. Particularly, for spatially correlated noise and realistic microscopy images, the proposed method not only achieves better perceptual quality but also has higher PSNR than supervised methods. Besides, it shows remarkable superiority in harsh practical conditions with complex noise, e.g., raw depth images.

READ FULL TEXT

page 17

page 18

page 20

page 28

page 29

page 30

page 31

page 33

research
04/29/2023

Sparsity-Aware Optimal Transport for Unsupervised Restoration Learning

Recent studies show that, without any prior model, the unsupervised rest...
research
07/06/2021

HybrUR: A Hybrid Physical-Neural Solution for Unsupervised Underwater Image Restoration

Robust vision restoration for an underwater image remains a challenging ...
research
06/04/2023

Deep Optimal Transport: A Practical Algorithm for Photo-realistic Image Restoration

We propose an image restoration algorithm that can control the perceptua...
research
03/28/2020

Learning Invariant Representation for Unsupervised Image Restoration

Recently, cross domain transfer has been applied for unsupervised image ...
research
03/04/2021

Perceptual Image Restoration with High-Quality Priori and Degradation Learning

Perceptual image restoration seeks for high-fidelity images that most li...
research
02/13/2023

Robust Unsupervised StyleGAN Image Restoration

GAN-based image restoration inverts the generative process to repair ima...
research
07/10/2020

Efficient Unpaired Image Dehazing with Cyclic Perceptual-Depth Supervision

Image dehazing without paired haze-free images is of immense importance,...

Please sign up or login with your details

Forgot password? Click here to reset