(DE)^2 CO: Deep Depth Colorization

03/31/2017
by   F. M. Carlucci, et al.
0

Object recognition on depth images using convolutional neural networks requires mapping the data collected with depth sensors into three dimensional channels. This makes them processable by deep architectures, pre-trained over large scale RGB databases like ImageNet. Current mappings are based on heuristic assumptions over what depth properties should be most preserved, resulting often in cumbersome data visualizations, and likely in sub-optimal recognition results. Here we take an alternative route and we attempt instead to learn an optimal colorization mapping for any given pre-trained architecture, using as training data a reference RGB-D database. We propose a deep network architecture, exploiting the residual paradigm, that learns how to map depth data to three channel images from a reference database. A qualitative analysis of the images obtained with this approach clearly indicates that learning the optimal mapping for depth data preserves the richness of depth information much better than hand-crafted approaches currently in use. Experiments on the Washington, JHUIT-50 and BigBIRD public benchmark databases, using AlexNet, VGG-16, GoogleNet, ResNet and SqueezeNet, clearly showcase the power of our approach, with gains in performance of up to 17% compared to the state of the art.

READ FULL TEXT

page 3

page 5

page 6

page 7

research
09/30/2016

A deep representation for depth images from synthetic data

Convolutional Neural Networks (CNNs) trained on large scale RGB database...
research
04/06/2016

Correlated and Individual Multi-Modal Deep Learning for RGB-D Object Recognition

In this paper, we propose a new correlated and individual multi-modal de...
research
09/17/2018

Learning Effective RGB-D Representations for Scene Recognition

Deep convolutional networks (CNN) can achieve impressive results on RGB ...
research
03/28/2017

Learning and Refining of Privileged Information-based RNNs for Action Recognition from Depth Sequences

Existing RNN-based approaches for action recognition from depth sequence...
research
06/01/2016

Deeper Depth Prediction with Fully Convolutional Residual Networks

This paper addresses the problem of estimating the depth map of a scene ...
research
08/23/2022

DepthFake: a depth-based strategy for detecting Deepfake videos

Fake content has grown at an incredible rate over the past few years. Th...
research
01/01/2022

Turath-150K: Image Database of Arab Heritage

Large-scale image databases remain largely biased towards objects and ac...

Please sign up or login with your details

Forgot password? Click here to reset