HybrUR: A Hybrid Physical-Neural Solution for Unsupervised Underwater Image Restoration

07/06/2021
by   Shuaizheng Yan, et al.
6

Robust vision restoration for an underwater image remains a challenging problem. For the lack of aligned underwater-terrestrial image pairs, the unsupervised method is more suited to this task. However, the pure data-driven unsupervised method usually has difficulty in achieving realistic color correction for lack of optical constraint. In this paper, we propose a data- and physics-driven unsupervised architecture that learns underwater vision restoration from unpaired underwater-terrestrial images. For sufficient domain transformation and detail preservation, the underwater degeneration needs to be explicitly constructed based on the optically unambiguous physics law. Thus, we employ the Jaffe-McGlamery degradation theory to design the generation models, and use neural networks to describe the process of underwater degradation. Furthermore, to overcome the problem of invalid gradient when optimizing the hybrid physical-neural model, we fully investigate the intrinsic correlation between the scene depth and the degradation factors for the backscattering estimation, to improve the restoration performance through physical constraints. Our experimental results show that the proposed method is able to perform high-quality restoration for unconstrained underwater images without any supervision. On multiple benchmarks, we outperform several state-of-the-art supervised and unsupervised approaches. We also demonstrate that our methods yield encouraging results on real-world applications.

READ FULL TEXT

page 1

page 3

page 4

page 7

page 8

page 9

page 10

page 11

research
03/17/2021

Single Underwater Image Restoration by Contrastive Learning

Underwater image restoration attracts significant attention due to its i...
research
12/21/2019

UWGAN: Underwater GAN for Real-world Underwater Color Restoration and Dehazing

In real-world underwater environment, exploration of seabed resources, u...
research
08/23/2023

Synergistic Multiscale Detail Refinement via Intrinsic Supervision for Underwater Image Enhancement

Visual restoration of underwater scenes is crucial for visual tasks, and...
research
08/04/2021

Optimal Transport for Unsupervised Restoration Learning

Recently, much progress has been made in unsupervised restoration learni...
research
03/04/2020

Reveal of Domain Effect: How Visual Restoration Contributes to Object Detection in Aquatic Scenes

Underwater robotic perception usually requires visual restoration and ob...
research
06/20/2021

Underwater Image Restoration via Contrastive Learning and a Real-world Dataset

Underwater image restoration is of significant importance in unveiling t...
research
03/26/2021

Marine Snow Removal Benchmarking Dataset

This paper introduces a new benchmarking dataset for marine snow removal...

Please sign up or login with your details

Forgot password? Click here to reset