WHU-Stereo: A Challenging Benchmark for Stereo Matching of High-Resolution Satellite Images

06/06/2022
by   Shenhong Li, et al.
24

Stereo matching of high-resolution satellite images (HRSI) is still a fundamental but challenging task in the field of photogrammetry and remote sensing. Recently, deep learning (DL) methods, especially convolutional neural networks (CNNs), have demonstrated tremendous potential for stereo matching on public benchmark datasets. However, datasets for stereo matching of satellite images are scarce. To facilitate further research, this paper creates and publishes a challenging dataset, termed WHU-Stereo, for stereo matching DL network training and testing. This dataset is created by using airborne LiDAR point clouds and high-resolution stereo imageries taken from the Chinese GaoFen-7 satellite (GF-7). The WHU-Stereo dataset contains more than 1700 epipolar rectified image pairs, which cover six areas in China and includes various kinds of landscapes. We have assessed the accuracy of ground-truth disparity maps, and it is proved that our dataset achieves comparable precision compared with existing state-of-the-art stereo matching datasets. To verify its feasibility, in experiments, the hand-crafted SGM stereo matching algorithm and recent deep learning networks have been tested on the WHU-Stereo dataset. Experimental results show that deep learning networks can be well trained and achieves higher performance than hand-crafted SGM algorithm, and the dataset has great potential in remote sensing application. The WHU-Stereo dataset can serve as a challenging benchmark for stereo matching of high-resolution satellite images, and performance evaluation of deep learning models. Our dataset is available at https://github.com/Sheng029/WHU-Stereo

READ FULL TEXT

page 4

page 5

page 6

page 7

page 9

page 10

page 11

page 12

research
10/25/2022

A Comparative Study on Deep-Learning Methods for Dense Image Matching of Multi-angle and Multi-date Remote Sensing Stereo Images

Deep learning (DL) stereo matching methods gained great attention in rem...
research
02/20/2023

UAVStereo: A Multiple Resolution Dataset for Stereo Matching in UAV Scenarios

Stereo matching is a fundamental task for 3D scene reconstruction. Recen...
research
07/09/2019

A New Stereo Benchmarking Dataset for Satellite Images

In order to facilitate further research in stereo reconstruction with mu...
research
05/27/2022

Fine-tuning deep learning models for stereo matching using results from semi-global matching

Deep learning (DL) methods are widely investigated for stereo image matc...
research
04/08/2021

SMD-Nets: Stereo Mixture Density Networks

Despite stereo matching accuracy has greatly improved by deep learning i...
research
03/08/2021

Deep Gradient Projection Networks for Pan-sharpening

Pan-sharpening is an important technique for remote sensing imaging syst...
research
11/20/2018

See far with TPNET: a Tile Processor and a CNN Symbiosis

Throughout the evolution of the neural networks more specialized cells w...

Please sign up or login with your details

Forgot password? Click here to reset