Sensor-Independent Illumination Estimation for DNN Models

12/14/2019
by   Mahmoud Afifi, et al.
10

While modern deep neural networks (DNNs) achieve state-of-the-art results for illuminant estimation, it is currently necessary to train a separate DNN for each type of camera sensor. This means when a camera manufacturer uses a new sensor, it is necessary to retrain an existing DNN model with training images captured by the new sensor. This paper addresses this problem by introducing a novel sensor-independent illuminant estimation framework. Our method learns a sensor-independent working space that can be used to canonicalize the RGB values of any arbitrary camera sensor. Our learned space retains the linear property of the original sensor raw-RGB space and allows unseen camera sensors to be used on a single DNN model trained on this working space. We demonstrate the effectiveness of this approach on several different camera sensors and show it provides performance on par with state-of-the-art methods that were trained per sensor.

READ FULL TEXT

page 5

page 6

page 7

page 9

page 10

page 11

page 12

page 13

research
02/13/2020

Replacing Mobile Camera ISP with a Single Deep Learning Model

As the popularity of mobile photography is growing constantly, lots of e...
research
06/23/2020

CIE XYZ Net: Unprocessing Images for Low-Level Computer Vision Tasks

Cameras currently allow access to two image states: (i) a minimally proc...
research
07/19/2004

Channel-Independent and Sensor-Independent Stimulus Representations

This paper shows how a machine, which observes stimuli through an unchar...
research
11/16/2021

SEnSeI: A Deep Learning Module for Creating Sensor Independent Cloud Masks

We introduce a novel neural network architecture – Spectral ENcoder for ...
research
11/14/2020

A needle-based deep-neural-network camera

We experimentally demonstrate a camera whose primary optic is a cannula ...
research
03/21/2022

Learning Enriched Illuminants for Cross and Single Sensor Color Constancy

Color constancy aims to restore the constant colors of a scene under dif...
research
10/08/2013

A State Of the Art Report on Research in Multiple RGB-D sensor Setups

That the Microsoft Kinect, an RGB-D sensor, transformed the gaming and e...

Please sign up or login with your details

Forgot password? Click here to reset