Deep Camera: A Fully Convolutional Neural Network for Image Signal Processing

A conventional camera performs various signal processing steps sequentially to reconstruct an image from a raw Bayer image. When performing these processing in multiple stages the residual error from each stage accumulates in the image and degrades the quality of the final reconstructed image. In this paper, we present a fully convolutional neural network (CNN) to perform defect pixel correction, denoising, white balancing, exposure correction, demosaicing, color transform, and gamma encoding. To our knowledge, this is the first CNN trained end-to-end to perform the entire image signal processing pipeline in a camera. The neural network was trained using a large image database of raw Bayer images. Through extensive experiments, we show that the proposed CNN based image signal processing system performs better than the conventional signal processing pipelines that perform the processing sequentially.

READ FULL TEXT

page 1

page 5

page 7

page 9

page 10

research
08/03/2021

Del-Net: A Single-Stage Network for Mobile Camera ISP

The quality of images captured by smartphones is an important specificat...
research
01/20/2018

DeepISP: Learning End-to-End Image Processing Pipeline

We present DeepISP, a full end-to-end deep neural model of the camera im...
research
11/16/2022

Camera simulation for robot simulation: how important are various camera model components?

Modeling cameras for the simulation of autonomous robotics is critical f...
research
11/11/2022

StereoISP: Rethinking Image Signal Processing for Dual Camera Systems

Conventional image signal processing (ISP) frameworks are designed to re...
research
12/08/2019

Neural Network Generalization: The impact of camera parameters

We quantify the generalization of a convolutional neural network (CNN) t...
research
09/10/2021

Automatic Displacement and Vibration Measurement in Laboratory Experiments with A Deep Learning Method

This paper proposes a pipeline to automatically track and measure displa...
research
08/05/2019

CameraNet: A Two-Stage Framework for Effective Camera ISP Learning

Traditional image signal processing (ISP) pipeline consists of a set of ...

Please sign up or login with your details

Forgot password? Click here to reset