Finding Point with Image: An End-to-End Benchmark for Vision-based UAV Localization

08/13/2022
by   Ming Dai, et al.
7

In the past, image retrieval was the mainstream solution for cross-view geolocation and UAV visual localization tasks. In a nutshell, the way of image retrieval is to obtain the final required information, such as GPS, through a transitional perspective. However, the way of image retrieval is not completely end-to-end. And there are some redundant operations such as the need to prepare the feature library in advance, and the sampling interval problem of the gallery construction, which make it difficult to implement large-scale applications. In this article we propose an end-to-end positioning scheme, Finding Point with Image (FPI), which aims to directly find the corresponding location in the image of source B (satellite-view) through the image of source A (drone-view). To verify the feasibility of our framework, we construct a new dataset (UL14), which is designed to solve the UAV visual self-localization task. At the same time, we also build a transformer-based baseline to achieve end-to-end training. In addition, the previous evaluation methods are no longer applicable under the framework of FPI. Thus, Metre-level Accuracy (MA) and Relative Distance Score (RDS) are proposed to evaluate the accuracy of UAV localization. At the same time, we preliminarily compare FPI and image retrieval method, and the structure of FPI achieves better performance in both speed and efficiency. In particular, the task of FPI remains great challenges due to the large differences between different views and the drastic spatial scale transformation.

READ FULL TEXT

page 1

page 2

page 4

page 5

page 6

page 9

page 12

research
01/23/2022

Vision-Based UAV Localization System in Denial Environments

Unmanned Aerial Vehicle (UAV) localization capability is critical in a G...
research
04/10/2022

Beyond Cross-view Image Retrieval: Highly Accurate Vehicle Localization Using Satellite Image

This paper addresses the problem of vehicle-mounted camera localization ...
research
01/23/2022

A Transformer-Based Feature Segmentation and Region Alignment Method For UAV-View Geo-Localization

Cross-view geo-localization is a task of matching the same geographic im...
research
08/17/2022

Visual Cross-View Metric Localization with Dense Uncertainty Estimates

This work addresses visual cross-view metric localization for outdoor ro...
research
06/24/2021

Planetary UAV localization based on Multi-modal Registration with Pre-existing Digital Terrain Model

The autonomous real-time optical navigation of planetary UAV is of the k...
research
11/06/2022

A Geometrically Constrained Point Matching based on View-invariant Cross-ratios, and Homography

In computer vision, finding point correspondence among images plays an i...
research
03/17/2023

IRGen: Generative Modeling for Image Retrieval

While generative modeling has been ubiquitous in natural language proces...

Please sign up or login with your details

Forgot password? Click here to reset