Deep SIMBAD: Active Landmark-based Self-localization Using Ranking -based Scene Descriptor

09/06/2021
by   Tanaka Kanji, et al.
0

Landmark-based robot self-localization has recently garnered interest as a highly-compressive domain-invariant approach for performing visual place recognition (VPR) across domains (e.g., time of day, weather, and season). However, landmark-based self-localization can be an ill-posed problem for a passive observer (e.g., manual robot control), as many viewpoints may not provide an effective landmark view. In this study, we consider an active self-localization task by an active observer and present a novel reinforcement learning (RL)-based next-best-view (NBV) planner. Our contributions are as follows. (1) SIMBAD-based VPR: We formulate the problem of landmark-based compact scene description as SIMBAD (similarity-based pattern recognition) and further present its deep learning extension. (2) VPR-to-NBV knowledge transfer: We address the challenge of RL under uncertainty (i.e., active self-localization) by transferring the state recognition ability of VPR to the NBV. (3) NNQL-based NBV: We regard the available VPR as the experience database by adapting nearest-neighbor approximation of Q-learning (NNQL). The result shows an extremely compact data structure that compresses both the VPR and NBV into a single incremental inverted index. Experiments using the public NCLT dataset validated the effectiveness of the proposed approach.

READ FULL TEXT

page 1

page 2

page 4

research
02/23/2021

Domain-invariant NBV Planner for Active Cross-domain Self-localization

Pole-like landmark has received increasing attention as a domain-invaria...
research
04/22/2022

Transferring ConvNet Features from Passive to Active Robot Self-Localization: The Use of Ego-Centric and World-Centric Views

The training of a next-best-view (NBV) planner for visual place recognit...
research
09/26/2022

Learning Continuous Control Policies for Information-Theoretic Active Perception

This paper proposes a method for learning continuous control policies fo...
research
09/09/2021

S3G-ARM: Highly Compressive Visual Self-localization from Sequential Semantic Scene Graph Using Absolute and Relative Measurements

In this paper, we address the problem of image sequence-based self-local...
research
03/03/2016

Self-localization from Images with Small Overlap

With the recent success of visual features from deep convolutional neura...
research
05/10/2023

Active Semantic Localization with Graph Neural Embedding

Semantic localization, i.e., robot self-localization with semantic image...

Please sign up or login with your details

Forgot password? Click here to reset