Augmenting Visual Place Recognition with Structural Cues

02/29/2020
by   Amadeus Oertel, et al.
21

In this paper, we propose to augment image-based place recognition with structural cues. Specifically, these structural cues are obtained using structure-from-motion, such that no additional sensors are needed for place recognition. This is achieved by augmenting the 2D convolutional neural network (CNN) typically used for image-based place recognition with a 3D CNN that takes as input a voxel grid derived from the structure-from-motion point cloud. We evaluate different methods for fusing the 2D and 3D features and obtain best performance with global average pooling and simple concatenation. The resulting descriptor exhibits superior recognition performance compared to descriptors extracted from only one of the input modalities, including state-of-the-art image-based descriptors. Especially at low descriptor dimensionalities, we outperform state-of-the-art descriptors by up to 90

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 1

09/18/2018

Adding Cues to Binary Feature Descriptors for Visual Place Recognition

In this paper we propose an approach to embed continuous and selector cu...
04/10/2018

PointNetVLAD: Deep Point Cloud Based Retrieval for Large-Scale Place Recognition

Unlike its image based counterpart, point cloud based retrieval for plac...
11/22/2020

CORAL: Colored structural representation for bi-modal place recognition

Place recognition is indispensable for drift-free localization system. D...
10/20/2017

Employing Fusion of Learned and Handcrafted Features for Unconstrained Ear Recognition

We present an unconstrained ear recognition framework that outperforms s...
10/28/2019

Image-Based Place Recognition on Bucolic Environment Across Seasons From Semantic Edge Description

Most of the research effort on image-based place recognition is designed...
02/18/2022

MultiRes-NetVLAD: Augmenting Place Recognition Training with Low-Resolution Imagery

Visual Place Recognition (VPR) is a crucial component of 6-DoF localizat...
08/15/2016

Visual place recognition using landmark distribution descriptors

Recent work by Suenderhauf et al. [1] demonstrated improved visual place...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.