RenderNet: Visual Relocalization Using Virtual Viewpoints in Large-Scale Indoor Environments

07/26/2022
by   Jiahui Zhang, et al.
0

Visual relocalization has been a widely discussed problem in 3D vision: given a pre-constructed 3D visual map, the 6 DoF (Degrees-of-Freedom) pose of a query image is estimated. Relocalization in large-scale indoor environments enables attractive applications such as augmented reality and robot navigation. However, appearance changes fast in such environments when the camera moves, which is challenging for the relocalization system. To address this problem, we propose a virtual view synthesis-based approach, RenderNet, to enrich the database and refine poses regarding this particular scenario. Instead of rendering real images which requires high-quality 3D models, we opt to directly render the needed global and local features of virtual viewpoints and apply them in the subsequent image retrieval and feature matching operations respectively. The proposed method can largely improve the performance in large-scale indoor environments, e.g., achieving an improvement of 7.1% and 12.2% on the Inloc dataset.

READ FULL TEXT

page 1

page 2

page 5

research
03/28/2018

InLoc: Indoor Visual Localization with Dense Matching and View Synthesis

We seek to predict the 6 degree-of-freedom (6DoF) pose of a query photog...
research
05/19/2021

Large-scale Localization Datasets in Crowded Indoor Spaces

Estimating the precise location of a camera using visual localization en...
research
05/08/2023

A sensor fusion approach for improving implementation speed and accuracy of RTAB-Map algorithm based indoor 3D mapping

In recent years, 3D mapping for indoor environments has undergone consid...
research
05/11/2020

Reference Pose Generation for Visual Localization via Learned Features and View Synthesis

Visual Localization is one of the key enabling technologies for autonomo...
research
03/16/2017

Anisotropic-Scale Junction Detection and Matching for Indoor Images

Junctions play an important role in the characterization of local geomet...
research
08/13/2019

Is This The Right Place? Geometric-Semantic Pose Verification for Indoor Visual Localization

Visual localization in large and complex indoor scenes, dominated by wea...
research
04/08/2021

3D Surfel Map-Aided Visual Relocalization with Learned Descriptors

In this paper, we introduce a method for visual relocalization using the...

Please sign up or login with your details

Forgot password? Click here to reset