SGUIE-Net: Semantic Attention Guided Underwater Image Enhancement with Multi-Scale Perception

01/08/2022
by   Qi Qi, et al.
7

Due to the wavelength-dependent light attenuation, refraction and scattering, underwater images usually suffer from color distortion and blurred details. However, due to the limited number of paired underwater images with undistorted images as reference, training deep enhancement models for diverse degradation types is quite difficult. To boost the performance of data-driven approaches, it is essential to establish more effective learning mechanisms that mine richer supervised information from limited training sample resources. In this paper, we propose a novel underwater image enhancement network, called SGUIE-Net, in which we introduce semantic information as high-level guidance across different images that share common semantic regions. Accordingly, we propose semantic region-wise enhancement module to perceive the degradation of different semantic regions from multiple scales and feed it back to the global attention features extracted from its original scale. This strategy helps to achieve robust and visually pleasant enhancements to different semantic objects, which should thanks to the guidance of semantic information for differentiated enhancement. More importantly, for those degradation types that are not common in the training sample distribution, the guidance connects them with the already well-learned types according to their semantic relevance. Extensive experiments on the publicly available datasets and our proposed dataset demonstrated the impressive performance of SGUIE-Net. The code and proposed dataset are available at: https://trentqq.github.io/SGUIE-Net.html

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 6

page 8

page 9

page 15

page 16

page 17

page 18

page 19

03/17/2022

Medium Transmission Map Matters for Learning to Restore Real-World Underwater Images

Underwater visual perception is essentially important for underwater exp...
11/23/2021

U-shape Transformer for Underwater Image Enhancement

The light absorption and scattering of underwater impurities lead to poo...
02/04/2020

Simultaneous Enhancement and Super-Resolution of Underwater Imagery for Improved Visual Perception

In this paper, we introduce and tackle the simultaneous enhancement and ...
02/01/2021

Underwater Image Enhancement via Learning Water Type Desensitized Representations

For underwater applications, the effects of light absorption and scatter...
04/27/2021

Underwater Image Enhancement via Medium Transmission-Guided Multi-Color Space Embedding

Underwater images suffer from color casts and low contrast due to wavele...
08/20/2021

Single Underwater Image Enhancement Using an Analysis-Synthesis Network

Most deep models for underwater image enhancement resort to training on ...
11/12/2020

SVAM: Saliency-guided Visual Attention Modeling by Autonomous Underwater Robots

This paper presents a holistic approach to saliency-guided visual attent...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.