Underwater Image Enhancement by Transformer-based Diffusion Model with Non-uniform Sampling for Skip Strategy

09/07/2023
by   Yi Tang, et al.
0

In this paper, we present an approach to image enhancement with diffusion model in underwater scenes. Our method adapts conditional denoising diffusion probabilistic models to generate the corresponding enhanced images by using the underwater images and the Gaussian noise as the inputs. Additionally, in order to improve the efficiency of the reverse process in the diffusion model, we adopt two different ways. We firstly propose a lightweight transformer-based denoising network, which can effectively promote the time of network forward per iteration. On the other hand, we introduce a skip sampling strategy to reduce the number of iterations. Besides, based on the skip sampling strategy, we propose two different non-uniform sampling methods for the sequence of the time step, namely piecewise sampling and searching with the evolutionary algorithm. Both of them are effective and can further improve performance by using the same steps against the previous uniform sampling. In the end, we conduct a relative evaluation of the widely used underwater enhancement datasets between the recent state-of-the-art methods and the proposed approach. The experimental results prove that our approach can achieve both competitive performance and high efficiency. Our code is available at \href{mailto:https://github.com/piggy2009/DM_underwater}{\color{blue}{https://github.com/piggy2009/DM\_underwater}}.

READ FULL TEXT

page 3

page 7

page 8

research
07/20/2022

Uncertainty Inspired Underwater Image Enhancement

A main challenge faced in the deep learning-based Underwater Image Enhan...
research
04/29/2022

AdaInt: Learning Adaptive Intervals for 3D Lookup Tables on Real-time Image Enhancement

The 3D Lookup Table (3D LUT) is a highly-efficient tool for real-time im...
research
12/07/2022

Non-uniform Sampling Strategies for NeRF on 360° images

In recent years, the performance of novel view synthesis using perspecti...
research
03/16/2023

Denoising Diffusion Post-Processing for Low-Light Image Enhancement

Low-light image enhancement (LLIE) techniques attempt to increase the vi...
research
03/10/2023

Importance of Aligning Training Strategy with Evaluation for Diffusion Models in 3D Multiclass Segmentation

Recently, denoising diffusion probabilistic models (DDPM) have been appl...
research
03/08/2023

Learning Enhancement From Degradation: A Diffusion Model For Fundus Image Enhancement

The quality of a fundus image can be compromised by numerous factors, ma...
research
04/17/2023

SCANet: Self-Paced Semi-Curricular Attention Network for Non-Homogeneous Image Dehazing

The presence of non-homogeneous haze can cause scene blurring, color dis...

Please sign up or login with your details

Forgot password? Click here to reset