DeepAI AI Chat
Log In Sign Up

Beyond Joint Demosaicking and Denoising: An Image Processing Pipeline for a Pixel-bin Image Sensor

by   SMA Sharif, et al.
sejong university
University of Liberal Arts Bangladesh

Pixel binning is considered one of the most prominent solutions to tackle the hardware limitation of smartphone cameras. Despite numerous advantages, such an image sensor has to appropriate an artefact-prone non-Bayer colour filter array (CFA) to enable the binning capability. Contrarily, performing essential image signal processing (ISP) tasks like demosaicking and denoising, explicitly with such CFA patterns, makes the reconstruction process notably complicated. In this paper, we tackle the challenges of joint demosaicing and denoising (JDD) on such an image sensor by introducing a novel learning-based method. The proposed method leverages the depth and spatial attention in a deep network. The proposed network is guided by a multi-term objective function, including two novel perceptual losses to produce visually plausible images. On top of that, we stretch the proposed image processing pipeline to comprehensively reconstruct and enhance the images captured with a smartphone camera, which uses pixel binning techniques. The experimental results illustrate that the proposed method can outperform the existing methods by a noticeable margin in qualitative and quantitative comparisons. Code available:


page 2

page 6

page 7

page 8


A Two-stage Deep Network for High Dynamic Range Image Reconstruction

Mapping a single exposure low dynamic range (LDR) image into a high dyna...

SAGAN: Adversarial Spatial-asymmetric Attention for Noisy Nona-Bayer Reconstruction

Nona-Bayer colour filter array (CFA) pattern is considered one of the mo...

An Analysis and Implementation of the HDR+ Burst Denoising Method

HDR+ is an image processing pipeline presented by Google in 2016. At its...

DIFAR: Deep Image Formation and Retouching

We present a novel neural network architecture for the image signal proc...

PixelRL: Fully Convolutional Network with Reinforcement Learning for Image Processing

This paper tackles a new problem setting: reinforcement learning with pi...

Trinity of Pixel Enhancement: a Joint Solution for Demosaicking, Denoising and Super-Resolution

Demosaicing, denoising and super-resolution (SR) are of practical import...

A Machine Learning Imaging Core using Separable FIR-IIR Filters

We propose fixed-function neural network hardware that is designed to pe...

Code Repositories