DeepAI
Log In Sign Up

D2HNet: Joint Denoising and Deblurring with Hierarchical Network for Robust Night Image Restoration

07/07/2022
by   Yuzhi Zhao, et al.
0

Night imaging with modern smartphone cameras is troublesome due to low photon count and unavoidable noise in the imaging system. Directly adjusting exposure time and ISO ratings cannot obtain sharp and noise-free images at the same time in low-light conditions. Though many methods have been proposed to enhance noisy or blurry night images, their performances on real-world night photos are still unsatisfactory due to two main reasons: 1) Limited information in a single image and 2) Domain gap between synthetic training images and real-world photos (e.g., differences in blur area and resolution). To exploit the information from successive long- and short-exposure images, we propose a learning-based pipeline to fuse them. A D2HNet framework is developed to recover a high-quality image by deblurring and enhancing a long-exposure image under the guidance of a short-exposure image. To shrink the domain gap, we leverage a two-phase DeblurNet-EnhanceNet architecture, which performs accurate blur removal on a fixed low resolution so that it is able to handle large ranges of blur in different resolution inputs. In addition, we synthesize a D2-Dataset from HD videos and experiment on it. The results on the validation set and real photos demonstrate our methods achieve better visual quality and state-of-the-art quantitative scores. The D2HNet codes, models, and D2-Dataset can be found at https://github.com/zhaoyuzhi/D2HNet.

READ FULL TEXT

page 10

page 12

page 21

page 22

page 23

page 24

page 25

page 26

07/01/2020

Low-light Image Restoration with Short- and Long-exposure Raw Pairs

Low-light imaging with handheld mobile devices is a challenging issue. L...
11/23/2018

LSD_2 - Joint Denoising and Deblurring of Short and Long Exposure Images with Convolutional Neural Networks

This paper addresses the challenging problem of acquiring high-quality p...
06/06/2022

Day-to-Night Image Synthesis for Training Nighttime Neural ISPs

Many flagship smartphone cameras now use a dedicated neural image signal...
12/11/2019

Photosequencing of Motion Blur using Short and Long Exposures

Photosequencing aims to transform a motion blurred image to a sequence o...
08/12/2021

Deep Camera Obscura: An Image Restoration Pipeline for Lensless Pinhole Photography

The lensless pinhole camera is perhaps the earliest and simplest form of...
11/23/2020

Legacy Photo Editing with Learned Noise Prior

There are quite a number of photographs captured under undesirable condi...
03/26/2019

Kernel-Free Image Deblurring with a Pair of Blurred/Noisy Images

Complex blur like the mixup of space-variant and space-invariant blur, w...