S3E-GNN: Sparse Spatial Scene Embedding with Graph Neural Networks for Camera Relocalization

05/12/2022
by   Ran Cheng, et al.
14

Camera relocalization is the key component of simultaneous localization and mapping (SLAM) systems. This paper proposes a learning-based approach, named Sparse Spatial Scene Embedding with Graph Neural Networks (S3E-GNN), as an end-to-end framework for efficient and robust camera relocalization. S3E-GNN consists of two modules. In the encoding module, a trained S3E network encodes RGB images into embedding codes to implicitly represent spatial and semantic embedding code. With embedding codes and the associated poses obtained from a SLAM system, each image is represented as a graph node in a pose graph. In the GNN query module, the pose graph is transformed to form a embedding-aggregated reference graph for camera relocalization. We collect various scene datasets in the challenging environments to perform experiments. Our results demonstrate that S3E-GNN method outperforms the traditional Bag-of-words (BoW) for camera relocalization due to learning-based embedding and GNN powered scene matching mechanism.

READ FULL TEXT

page 2

page 3

page 4

page 6

page 10

research
03/17/2021

Pose-GNN : Camera Pose Estimation System Using Graph Neural Networks

We propose a novel image based localization system using graph neural ne...
research
09/29/2022

Graph Attention Network for Camera Relocalization on Dynamic Scenes

We devise a graph attention network-based approach for learning a scene ...
research
07/31/2023

MRA-GNN: Minutiae Relation-Aware Model over Graph Neural Network for Fingerprint Embedding

Deep learning has achieved remarkable results in fingerprint embedding, ...
research
11/17/2021

Probabilistic Spatial Distribution Prior Based Attentional Keypoints Matching Network

Keypoints matching is a pivotal component for many image-relevant applic...
research
04/19/2023

Solving the Kidney-Exchange Problem via Graph Neural Networks with No Supervision

This paper introduces a new learning-based approach for approximately so...
research
06/21/2023

DGC-GNN: Descriptor-free Geometric-Color Graph Neural Network for 2D-3D Matching

Direct matching of 2D keypoints in an input image to a 3D point cloud of...
research
08/15/2022

STAR-GNN: Spatial-Temporal Video Representation for Content-based Retrieval

We propose a video feature representation learning framework called STAR...

Please sign up or login with your details

Forgot password? Click here to reset