Leveraging Photogrammetric Mesh Models for Aerial-Ground Feature Point Matching Toward Integrated 3D Reconstruction

02/21/2020
by   Qing Zhu, et al.
0

Integration of aerial and ground images has been proved as an efficient approach to enhance the surface reconstruction in urban environments. However, as the first step, the feature point matching between aerial and ground images is remarkably difficult, due to the large differences in viewpoint and illumination conditions. Previous studies based on geometry-aware image rectification have alleviated this problem, but the performance and convenience of this strategy is limited by several flaws, e.g. quadratic image pairs, segregated extraction of descriptors and occlusions. To address these problems, we propose a novel approach: leveraging photogrammetric mesh models for aerial-ground image matching. The methods of this proposed approach have linear time complexity with regard to the number of images, can explicitly handle low overlap using multi-view images and can be directly injected into off-the-shelf structure-from-motion (SfM) and multi-view stereo (MVS) solutions. First, aerial and ground images are reconstructed separately and initially co-registered through weak georeferencing data. Second, aerial models are rendered to the initial ground views, in which the color, depth and normal images are obtained. Then, the synthesized color images and the corresponding ground images are matched by comparing the descriptors, filtered by local geometrical information, and then propagated to the aerial views using depth images and patch-based matching. Experimental evaluations using various datasets confirm the superior performance of the proposed methods in aerial-ground image matching. In addition, incorporation of the existing SfM and MVS solutions into these methods enables more complete and accurate models to be directly obtained.

READ FULL TEXT

page 7

page 9

page 11

page 12

page 15

page 16

page 18

research
04/24/2019

Bridging the Domain Gap for Ground-to-Aerial Image Matching

The visual entities in cross-view images exhibit drastic domain changes ...
research
08/03/2020

AiRound and CV-BrCT: Novel Multi-View Datasets for Scene Classification

It is undeniable that aerial/satellite images can provide useful informa...
research
03/31/2017

Optimal Reconstruction with a Small Number of Views

Estimating positions of world points from features observed in images is...
research
11/26/2020

Depth-Enhanced Feature Pyramid Network for Occlusion-Aware Verification of Buildings from Oblique Images

Detecting the changes of buildings in urban environments is essential. E...
research
04/08/2022

Investigating Spherical Epipolar Rectification for Multi-View Stereo 3D Reconstruction

Multi-view stereo (MVS) reconstruction is essential for creating 3D mode...
research
05/08/2023

Large-scale and Efficient Texture Mapping Algorithm via Loopy Belief Propagation

Texture mapping as a fundamental task in 3D modeling has been well estab...
research
11/23/2013

On the Design and Analysis of Multiple View Descriptors

We propose an extension of popular descriptors based on gradient orienta...

Please sign up or login with your details

Forgot password? Click here to reset