DeepAI AI Chat
Log In Sign Up

Photometric Multi-View Mesh Refinement for High-Resolution Satellite Images

by   Mathias Rothermel, et al.

Modern high-resolution satellite sensors collect optical imagery with ground sampling distances (GSDs) of 30-50cm, which has sparked a renewed interest in photogrammetric 3D surface reconstruction from satellite data. State-of-the-art reconstruction methods typically generate 2.5D elevation data. Here, we present an approach to recover full 3D surface meshes from multi-view satellite imagery. The proposed method takes as input a coarse initial mesh and refines it by iteratively updating all vertex positions to maximize the photo-consistency between images. Photo-consistency is measured in image space, by transferring texture from one image to another via the surface. We derive the equations to propagate changes in texture similarity through the rational function model (RFM), often also referred to as rational polynomial coefficient (RPC) model. Furthermore, we devise a hierarchical scheme to optimize the surface with gradient descent. In experiments with two different datasets, we show that the refinement improves the initial digital elevation models (DEMs) generated with conventional dense image matching. Moreover, we demonstrate that our method is able to reconstruct true 3D geometry, such as facade structures, if off-nadir views are available.


page 11

page 14

page 15

page 17


Multi-View Large-Scale Bundle Adjustment Method for High-Resolution Satellite Images

Given enough multi-view image corresponding points (also called tie poin...

Automatic Stockpile Volume Monitoring using Multi-view Stereo from SkySat Imagery

This paper proposes a system for automatic surface volume monitoring fro...

Efficient Multi-view Performance Capture of Fine-Scale Surface Detail

We present a new effective way for performance capture of deforming mesh...

A Unified Framework of Bundle Adjustment and Feature Matching for High-Resolution Satellite Images

Bundle adjustment (BA) is a technique for refining sensor orientations o...

NeRF applied to satellite imagery for surface reconstruction

We present Sat-NeRF, a modified implementation of the recently introduce...

Pursuing 3D Scene Structures with Optical Satellite Images from Affine Reconstruction to Euclidean Reconstruction

How to use multiple optical satellite images to recover the 3D scene str...

Rational Polynomial Camera Model Warping for Deep Learning Based Satellite Multi-View Stereo Matching

Satellite multi-view stereo (MVS) imagery is particularly suited for lar...