Residual Learning for Effective joint Demosaicing-Denoising

09/14/2020
by   Yu Guo, et al.
0

Image demosaicing and denoising are key steps for color image production pipeline. The classical processing sequence consists in applying denoising first, and then demosaicing. However, this sequence leads to oversmoothing and unpleasant checkerboard effect. Moreover, it is very difficult to change this order, because once the image is demosaiced, the statistical properties of the noise will be changed dramatically. This is extremely challenging for the traditional denoising models that strongly rely on statistical assumptions. In this paper, we attempt to tackle this prickly problem. Indeed, here we invert the traditional CFA processing pipeline by first applying demosaicing and then using an adapted denoising. In order to obtain high-quality demosaicing of noiseless images, we combine the advantages of traditional algorithms with deep learning. This is achieved by training convolutional neural networks (CNNs) to learn the residuals of traditional algorithms. To improve the performance in image demosaicing we propose a modified Inception architecture. Given the trained demosaicing as a basic component, we apply it to noisy images and use another CNN to learn the residual noise (including artifacts) of the demosaiced images, which allows to reconstruct full color images. Experimental results show clearly that this method outperforms several state-of-the-art methods both quantitatively as well as in terms of visual quality.

READ FULL TEXT

page 5

page 6

research
07/21/2018

A Convolutional Neural Networks Denoising Approach for Salt and Pepper Noise

The salt and pepper noise, especially the one with extremely high percen...
research
07/12/2018

Toward Convolutional Blind Denoising of Real Photographs

Despite their success in Gaussian denoising, deep convolutional neural n...
research
01/27/2020

Handling noise in image deblurring via joint learning

Currently, many blind deblurring methods assume blurred images are noise...
research
11/29/2018

Iterative Residual CNNs for Burst Photography Applications

Modern inexpensive imaging sensors suffer from inherent hardware constra...
research
05/13/2019

Joint demosaicing and denoising by overfitting of bursts of raw images

Demosaicking and denoising are the first steps of any camera image proce...
research
10/31/2018

Inception-Residual Block based Neural Network for Thermal Image Denoising

Thermal cameras shows noisy images due to their limited thermal resoluti...
research
04/24/2020

A Review of an Old Dilemma: Demosaicking First, or Denoising First?

Image denoising and demosaicking are the most important early stages in ...

Please sign up or login with your details

Forgot password? Click here to reset