Efficient Burst Raw Denoising with Variance Stabilization and Multi-frequency Denoising Network

05/10/2022
by   Dasong Li, et al.
0

With the growing popularity of smartphones, capturing high-quality images is of vital importance to smartphones. The cameras of smartphones have small apertures and small sensor cells, which lead to the noisy images in low light environment. Denoising based on a burst of multiple frames generally outperforms single frame denoising but with the larger compututional cost. In this paper, we propose an efficient yet effective burst denoising system. We adopt a three-stage design: noise prior integration, multi-frame alignment and multi-frame denoising. First, we integrate noise prior by pre-processing raw signals into a variance-stabilization space, which allows using a small-scale network to achieve competitive performance. Second, we observe that it is essential to adopt an explicit alignment for burst denoising, but it is not necessary to integrate a learning-based method to perform multi-frame alignment. Instead, we resort to a conventional and efficient alignment method and combine it with our multi-frame denoising network. At last, we propose a denoising strategy that processes multiple frames sequentially. Sequential denoising avoids filtering a large number of frames by decomposing multiple frames denoising into several efficient sub-network denoising. As for each sub-network, we propose an efficient multi-frequency denoising network to remove noise of different frequencies. Our three-stage design is efficient and shows strong performance on burst denoising. Experiments on synthetic and real raw datasets demonstrate that our method outperforms state-of-the-art methods, with less computational cost. Furthermore, the low complexity and high-quality performance make deployment on smartphones possible.

READ FULL TEXT

page 6

page 8

page 10

page 12

page 13

page 14

research
12/15/2017

Deep Burst Denoising

Noise is an inherent issue of low-light image capture, one which is exac...
research
03/04/2021

Multi-Stage Raw Video Denoising with Adversarial Loss and Gradient Mask

In this paper, we propose a learning-based approach for denoising raw vi...
research
02/20/2022

MANet: Improving Video Denoising with a Multi-Alignment Network

In video denoising, the adjacent frames often provide very useful inform...
research
03/17/2022

A Differentiable Two-stage Alignment Scheme for Burst Image Reconstruction with Large Shift

Denoising and demosaicking are two essential steps to reconstruct a clea...
research
04/13/2023

Gated Multi-Resolution Transfer Network for Burst Restoration and Enhancement

Burst image processing is becoming increasingly popular in recent years....
research
02/18/2023

One-Pot Multi-Frame Denoising

The performance of learning-based denoising largely depends on clean sup...
research
03/04/2022

Geodesic Gramian Denoising Applied to the Images Contaminated With Noise Sampled From Diverse Probability Distributions

As quotidian use of sophisticated cameras surges, people in modern socie...

Please sign up or login with your details

Forgot password? Click here to reset