Semi-Supervised Raw-to-Raw Mapping

06/25/2021
by   Mahmoud Afifi, et al.
12

The raw-RGB colors of a camera sensor vary due to the spectral sensitivity differences across different sensor makes and models. This paper focuses on the task of mapping between different sensor raw-RGB color spaces. Prior work addressed this problem using a pairwise calibration to achieve accurate color mapping. Although being accurate, this approach is less practical as it requires: (1) capturing pair of images by both camera devices with a color calibration object placed in each new scene; (2) accurate image alignment or manual annotation of the color calibration object. This paper aims to tackle color mapping in the raw space through a more practical setup. Specifically, we present a semi-supervised raw-to-raw mapping method trained on a small set of paired images alongside an unpaired set of images captured by each camera device. Through extensive experiments, we show that our method achieves better results compared to other domain adaptation alternatives in addition to the single-calibration solution. We have generated a new dataset of raw images from two different smartphone cameras as part of this effort. Our dataset includes unpaired and paired sets for our semi-supervised training and evaluation.

READ FULL TEXT

page 2

page 3

page 4

page 5

page 6

page 8

page 10

page 11

research
11/24/2020

Cross-Camera Convolutional Color Constancy

We present "Cross-Camera Convolutional Color Constancy" (C5), a learning...
research
11/20/2019

W-Net: Two-stage U-Net with misaligned data for raw-to-RGB mapping

Recent research on a learning mapping between raw Bayer images and RGB i...
research
03/21/2022

Learning Enriched Illuminants for Cross and Single Sensor Color Constancy

Color constancy aims to restore the constant colors of a scene under dif...
research
08/13/2018

Vision-Based Preharvest Yield Mapping for Apple Orchards

We present an end-to-end computer vision system for mapping yield in an ...
research
03/20/2022

Transform your Smartphone into a DSLR Camera: Learning the ISP in the Wild

We propose a trainable Image Signal Processing (ISP) framework that prod...
research
05/07/2022

GenISP: Neural ISP for Low-Light Machine Cognition

Object detection in low-light conditions remains a challenging but impor...
research
08/18/2021

Learning RAW-to-sRGB Mappings with Inaccurately Aligned Supervision

Learning RAW-to-sRGB mapping has drawn increasing attention in recent ye...

Please sign up or login with your details

Forgot password? Click here to reset