Cascading Convolutional Temporal Colour Constancy

06/15/2021
by   Matteo Rizzo, et al.
9

Computational Colour Constancy (CCC) consists of estimating the colour of one or more illuminants in a scene and using them to remove unwanted chromatic distortions. Much research has focused on illuminant estimation for CCC on single images, with few attempts of leveraging the temporal information intrinsic in sequences of correlated images (e.g., the frames in a video), a task known as Temporal Colour Constancy (TCC). The state-of-the-art for TCC is TCCNet, a deep-learning architecture that uses a ConvLSTM for aggregating the encodings produced by CNN submodules for each image in a sequence. We extend this architecture with different models obtained by (i) substituting the TCCNet submodules with C4, the state-of-the-art method for CCC targeting images; (ii) adding a cascading strategy to perform an iterative improvement of the estimate of the illuminant. We tested our models on the recently released TCC benchmark and achieved results that surpass the state-of-the-art. Analyzing the impact of the number of frames involved in illuminant estimation on performance, we show that it is possible to reduce inference time by training the models on few selected frames from the sequences while retaining comparable accuracy.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 1

page 3

page 4

page 5

02/11/2020

Learning spatio-temporal representations with temporal squeeze pooling

In this paper, we propose a new video representation learning method, na...
07/19/2019

Only Time Can Tell: Discovering Temporal Data for Temporal Modeling

Understanding temporal information and how the visual world changes over...
04/24/2019

ViDeNN: Deep Blind Video Denoising

We propose ViDeNN: a CNN for Video Denoising without prior knowledge on ...
02/01/2021

Exploiting multi-temporal information for improved speckle reduction of Sentinel-1 SAR images by deep learning

Deep learning approaches show unprecedented results for speckle reductio...
05/10/2018

Dealing with sequences in the RGBDT space

Most of the current research in computer vision is focused on working wi...
11/15/2019

You Only Watch Once: A Unified CNN Architecture for Real-Time Spatiotemporal Action Localization

Spatiotemporal action localization requires incorporation of two sources...
09/26/2019

Deep Video Deblurring: The Devil is in the Details

Video deblurring for hand-held cameras is a challenging task, since the ...

Code Repositories

cctcc

Cascading Convolutional Temporal Color Constancy (TCC)


view repo
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.