D2HNet: Joint Denoising and Deblurring with Hierarchical Network for Robust Night Image Restoration

by   Yuzhi Zhao, et al.

Night imaging with modern smartphone cameras is troublesome due to low photon count and unavoidable noise in the imaging system. Directly adjusting exposure time and ISO ratings cannot obtain sharp and noise-free images at the same time in low-light conditions. Though many methods have been proposed to enhance noisy or blurry night images, their performances on real-world night photos are still unsatisfactory due to two main reasons: 1) Limited information in a single image and 2) Domain gap between synthetic training images and real-world photos (e.g., differences in blur area and resolution). To exploit the information from successive long- and short-exposure images, we propose a learning-based pipeline to fuse them. A D2HNet framework is developed to recover a high-quality image by deblurring and enhancing a long-exposure image under the guidance of a short-exposure image. To shrink the domain gap, we leverage a two-phase DeblurNet-EnhanceNet architecture, which performs accurate blur removal on a fixed low resolution so that it is able to handle large ranges of blur in different resolution inputs. In addition, we synthesize a D2-Dataset from HD videos and experiment on it. The results on the validation set and real photos demonstrate our methods achieve better visual quality and state-of-the-art quantitative scores. The D2HNet codes, models, and D2-Dataset can be found at https://github.com/zhaoyuzhi/D2HNet.


page 10

page 12

page 21

page 22

page 23

page 24

page 25

page 26


Low-light Image Restoration with Short- and Long-exposure Raw Pairs

Low-light imaging with handheld mobile devices is a challenging issue. L...

Dual-Camera Joint Deblurring-Denoising

Recent image enhancement methods have shown the advantages of using a pa...

Day-to-Night Image Synthesis for Training Nighttime Neural ISPs

Many flagship smartphone cameras now use a dedicated neural image signal...

LSD_2 - Joint Denoising and Deblurring of Short and Long Exposure Images with Convolutional Neural Networks

This paper addresses the challenging problem of acquiring high-quality p...

Photosequencing of Motion Blur using Short and Long Exposures

Photosequencing aims to transform a motion blurred image to a sequence o...

Deep Camera Obscura: An Image Restoration Pipeline for Lensless Pinhole Photography

The lensless pinhole camera is perhaps the earliest and simplest form of...

Legacy Photo Editing with Learned Noise Prior

There are quite a number of photographs captured under undesirable condi...

Please sign up or login with your details

Forgot password? Click here to reset