Visual Localization Using Sparse Semantic 3D Map

04/08/2019
by   Tianxin Shi, et al.
1

Accurate and robust visual localization under a wide range of viewing condition variations including season and illumination changes, as well as weather and day-night variations, is the key component for many computer vision and robotics applications. Under these conditions, most traditional methods would fail to locate the camera. In this paper we present a visual localization algorithm that combines structure-based method and image-based method with semantic information. Given semantic information about the query and database images, the retrieved images are scored according to the semantic consistency of the 3D model and the query image. Then the semantic matching score is used as weight for RANSAC's sampling and the pose is solved by a standard PnP solver. Experiments on the challenging long-term visual localization benchmark dataset demonstrate that our method has significant improvement compared with the state-of-the-arts.

READ FULL TEXT

page 1

page 2

page 3

page 4

page 5

research
05/21/2020

Dense Semantic 3D Map Based Long-Term Visual Localization with Hybrid Features

Visual localization plays an important role in many applications. Howeve...
research
03/31/2022

Semantic Pose Verification for Outdoor Visual Localization with Self-supervised Contrastive Learning

Any city-scale visual localization system has to overcome long-term appe...
research
12/15/2017

Semantic Visual Localization

Robust visual localization under a wide range of viewing conditions is a...
research
12/08/2018

Semantically-Aware Attentive Neural Embeddings for Image-based Visual Localization

We present a novel method for fusing appearance and semantic information...
research
09/09/2021

CrowdDriven: A New Challenging Dataset for Outdoor Visual Localization

Visual localization is the problem of estimating the position and orient...
research
12/10/2018

Efficient Condition-based Representations for Long-Term Visual Localization

We propose an approach to localization from images that is designed to e...

Please sign up or login with your details

Forgot password? Click here to reset