INFWIDE: Image and Feature Space Wiener Deconvolution Network for Non-blind Image Deblurring in Low-Light Conditions

07/17/2022
by   Zhihong Zhang, et al.
0

Under low-light environment, handheld photography suffers from severe camera shake under long exposure settings. Although existing deblurring algorithms have shown promising performance on well-exposed blurry images, they still cannot cope with low-light snapshots. Sophisticated noise and saturation regions are two dominating challenges in practical low-light deblurring. In this work, we propose a novel non-blind deblurring method dubbed image and feature space Wiener deconvolution network (INFWIDE) to tackle these problems systematically. In terms of algorithm design, INFWIDE proposes a two-branch architecture, which explicitly removes noise and hallucinates saturated regions in the image space and suppresses ringing artifacts in the feature space, and integrates the two complementary outputs with a subtle multi-scale fusion network for high quality night photograph deblurring. For effective network training, we design a set of loss functions integrating a forward imaging model and backward reconstruction to form a close-loop regularization to secure good convergence of the deep neural network. Further, to optimize INFWIDE's applicability in real low-light conditions, a physical-process-based low-light noise model is employed to synthesize realistic noisy night photographs for model training. Taking advantage of the traditional Wiener deconvolution algorithm's physically driven characteristics and arisen deep neural network's representation ability, INFWIDE can recover fine details while suppressing the unpleasant artifacts during deblurring. Extensive experiments on synthetic data and real data demonstrate the superior performance of the proposed approach.

READ FULL TEXT

page 1

page 4

page 6

page 8

page 9

page 10

page 11

page 13

research
03/18/2021

Deep Wiener Deconvolution: Wiener Meets Deep Learning for Image Deblurring

We present a simple and effective approach for non-blind image deblurrin...
research
07/01/2020

Low-light Image Restoration with Short- and Long-exposure Raw Pairs

Low-light imaging with handheld mobile devices is a challenging issue. L...
research
04/10/2018

Learning an Optimizer for Image Deconvolution

As an integral component of blind image deblurring, non-blind deconvolut...
research
08/24/2022

AutoDeconJ: a GPU accelerated ImageJ plugin for 3D light field deconvolution with optimal iteration numbers predicting

Light field microscopy is a compact solution to high-speed 3D fluorescen...
research
08/04/2021

Physics-based Noise Modeling for Extreme Low-light Photography

Enhancing the visibility in extreme low-light environments is a challeng...
research
03/17/2020

Burst Denoising of Dark Images

Capturing images under extremely low-light conditions poses significant ...
research
06/17/2020

Burst Photography for Learning to Enhance Extremely Dark Images

Capturing images under extremely low-light conditions poses significant ...

Please sign up or login with your details

Forgot password? Click here to reset