Translate to Adapt: RGB-D Scene Recognition across Domains

03/26/2021
by   Andrea Ferreri, et al.
0

Scene classification is one of the basic problems in computer vision research with extensive applications in robotics. When available, depth images provide helpful geometric cues that complement the RGB texture information and help to identify more discriminative scene image features. Depth sensing technology developed fast in the last years and a great variety of 3D cameras have been introduced, each with different acquisition properties. However, when targeting big data collections, often multi-modal images are gathered disregarding their original nature. In this work we put under the spotlight the existence of a possibly severe domain shift issue within multi-modality scene recognition datasets. We design an experimental testbed to study this problem and present a method based on self-supervised inter-modality translation able to adapt across different camera domains. Our extensive experimental analysis confirms the effectiveness of the proposed approach.

READ FULL TEXT

page 1

page 6

research
04/28/2019

Translate-to-Recognize Networks for RGB-D Scene Recognition

Cross-modal transfer is helpful to enhance modality-specific discriminat...
research
05/10/2023

A Multi-modal Approach to Single-modal Visual Place Classification

Visual place classification from a first-person-view monocular RGB image...
research
02/17/2020

3D Gated Recurrent Fusion for Semantic Scene Completion

This paper tackles the problem of data fusion in the semantic scene comp...
research
01/21/2018

Depth CNNs for RGB-D scene recognition: learning from scratch better than transferring from RGB-CNNs

Scene recognition with RGB images has been extensively studied and has r...
research
04/13/2021

SPARK: SPAcecraft Recognition leveraging Knowledge of Space Environment

This paper proposes the SPARK dataset as a new unique space object multi...
research
07/21/2022

MetaComp: Learning to Adapt for Online Depth Completion

Relying on deep supervised or self-supervised learning, previous methods...

Please sign up or login with your details

Forgot password? Click here to reset