S3G-ARM: Highly Compressive Visual Self-localization from Sequential Semantic Scene Graph Using Absolute and Relative Measurements

09/09/2021
by   Mitsuki Yoshida, et al.
0

In this paper, we address the problem of image sequence-based self-localization (ISS) from a new highly compressive scene representation called sequential semantic scene graph (S3G). Recent developments in deep graph convolutional neural networks (GCNs) have enabled a highly compressive visual place classifier (VPC) that can use a scene graph as the input modality. However, in such a highly compressive application, the amount of information lost in the image-to-graph mapping is significant and can damage the classification performance. To address this issue, we propose a pair of similarity-preserving mappings, image-to-nodes and image-to-edges, such that the nodes and edges act as absolute and relative features, respectively, that complement each other. Moreover, the proposed GCN-VPC is applied to a new task of viewpoint planning (VP) of the query image sequence, which contributes to further improvement in the VPC performance. Experiments using the public NCLT dataset validated the effectiveness of the proposed method.

READ FULL TEXT

page 1

page 3

page 4

page 5

research
11/01/2020

Dark Reciprocal-Rank: Boosting Graph-Convolutional Self-Localization Network via Teacher-to-student Knowledge Transfer

In visual robot self-localization, graph-based scene representation and ...
research
08/03/2022

Compressive Self-localization Using Relative Attribute Embedding

The use of relative attribute (e.g., beautiful, safe, convenient) -based...
research
05/10/2023

Active Semantic Localization with Graph Neural Embedding

Semantic localization, i.e., robot self-localization with semantic image...
research
09/06/2021

Deep SIMBAD: Active Landmark-based Self-localization Using Ranking -based Scene Descriptor

Landmark-based robot self-localization has recently garnered interest as...
research
12/08/2018

Semantically-Aware Attentive Neural Embeddings for Image-based Visual Localization

We present a novel method for fusing appearance and semantic information...
research
03/03/2016

Self-localization from Images with Small Overlap

With the recent success of visual features from deep convolutional neura...
research
06/12/2019

Compressive Hyperspherical Energy Minimization

Recent work on minimum hyperspherical energy (MHE) has demonstrated its ...

Please sign up or login with your details

Forgot password? Click here to reset