DeepAI AI Chat
Log In Sign Up

Feature Map Filtering: Improving Visual Place Recognition with Convolutional Calibration

10/30/2018
by   Stephen Hausler, et al.
qut
0

Convolutional Neural Networks (CNNs) have recently been shown to excel at performing visual place recognition under changing appearance and viewpoint. Previously, place recognition has been improved by intelligently selecting relevant spatial keypoints within a convolutional layer and also by selecting the optimal layer to use. Rather than extracting features out of a particular layer, or a particular set of spatial keypoints within a layer, we propose the extraction of features using a subset of the channel dimensionality within a layer. Each feature map learns to encode a different set of weights that activate for different visual features within the set of training images. We propose a method of calibrating a CNN-based visual place recognition system, which selects the subset of feature maps that best encodes the visual features that are consistent between two different appearances of the same location. Using just 50 calibration images, all collected at the beginning of the current environment, we demonstrate a significant and consistent recognition improvement across multiple layers for two different neural networks. We evaluate our proposal on three datasets with different types of appearance changes - afternoon to morning, winter to summer and night to day. Additionally, the dimensionality reduction approach improves the computational processing speed of the recognition system.

READ FULL TEXT

page 2

page 4

page 6

page 7

page 8

page 9

06/21/2019

Filter Early, Match Late: Improving Network-Based Visual Place Recognition

CNNs have excelled at performing place recognition over time, particular...
03/25/2021

STA-VPR: Spatio-temporal Alignment for Visual Place Recognition

Recently, the methods based on Convolutional Neural Networks (CNNs) have...
06/24/2021

Topological Semantic Mapping by Consolidation of Deep Visual Features

Many works in the recent literature introduce semantic mapping methods t...
03/09/2018

Adversarial Training for Adverse Conditions: Robust Metric Localisation using Appearance Transfer

We present a method of improving visual place recognition and metric loc...
12/29/2020

Learning a Dynamic Map of Visual Appearance

The appearance of the world varies dramatically not only from place to p...
11/01/2018

Introduction to the 1st Place Winning Model of OpenImages Relationship Detection Challenge

This article describes the model we built that achieved 1st place in the...
12/03/2018

Towards Visual Feature Translation

Most existing visual search systems are deployed based upon fixed kinds ...