Semantic Signatures for Large-scale Visual Localization

05/07/2020
by   Li Weng, et al.
0

Visual localization is a useful alternative to standard localization techniques. It works by utilizing cameras. In a typical scenario, features are extracted from captured images and compared with geo-referenced databases. Location information is then inferred from the matching results. Conventional schemes mainly use low-level visual features. These approaches offer good accuracy but suffer from scalability issues. In order to assist localization in large urban areas, this work explores a different path by utilizing high-level semantic information. It is found that object information in a street view can facilitate localization. A novel descriptor scheme called "semantic signature" is proposed to summarize this information. A semantic signature consists of type and angle information of visible objects at a spatial location. Several metrics and protocols are proposed for signature comparison and retrieval. They illustrate different trade-offs between accuracy and complexity. Extensive simulation results confirm the potential of the proposed scheme in large-scale applications. This paper is an extended version of a conference paper in CBMI'18. A more efficient retrieval protocol is presented with additional experiment results.

READ FULL TEXT

page 3

page 4

01/14/2022

Code-based Signatures from New Proofs of Knowledge for the Syndrome Decoding Problem

In this paper, we study code-based signatures constructed from Proof of ...
05/01/2019

Accurate Visual Localization for Automotive Applications

Accurate vehicle localization is a crucial step towards building effecti...
02/01/2015

Efficient refinement of GPS-based localization in urban areas using visual information and sensor parameter

An efficient method is proposed for refining GPS-acquired location coord...
12/15/2017

Semantic Visual Localization

Robust visual localization under a wide range of viewing conditions is a...
03/31/2022

Semantic Pose Verification for Outdoor Visual Localization with Self-supervised Contrastive Learning

Any city-scale visual localization system has to overcome long-term appe...
10/27/2020

SIRI: Spatial Relation Induced Network For Spatial Description Resolution

Spatial Description Resolution, as a language-guided localization task, ...
07/26/2022

Location retrieval using visible landmarks based qualitative place signatures

Location retrieval based on visual information is to retrieve the locati...

Please sign up or login with your details

Forgot password? Click here to reset