Ground material classification and for UAV-based photogrammetric 3D data A 2D-3D Hybrid Approach

09/24/2021
by   Meida Chen, et al.
0

In recent years, photogrammetry has been widely used in many areas to create photorealistic 3D virtual data representing the physical environment. The innovation of small unmanned aerial vehicles (sUAVs) has provided additional high-resolution imaging capabilities with low cost for mapping a relatively large area of interest. These cutting-edge technologies have caught the US Army and Navy's attention for the purpose of rapid 3D battlefield reconstruction, virtual training, and simulations. Our previous works have demonstrated the importance of information extraction from the derived photogrammetric data to create semantic-rich virtual environments (Chen et al., 2019). For example, an increase of simulation realism and fidelity was achieved by segmenting and replacing photogrammetric trees with game-ready tree models. In this work, we further investigated the semantic information extraction problem and focused on the ground material segmentation and object detection tasks. The main innovation of this work was that we leveraged both the original 2D images and the derived 3D photogrammetric data to overcome the challenges faced when using each individual data source. For ground material segmentation, we utilized an existing convolutional neural network architecture (i.e., 3DMV) which was originally designed for segmenting RGB-D sensed indoor data. We improved its performance for outdoor photogrammetric data by introducing a depth pooling layer in the architecture to take into consideration the distance between the source images and the reconstructed terrain model. To test the performance of our improved 3DMV, a ground truth ground material database was created using data from the One World Terrain (OWT) data repository. Finally, a workflow for importing the segmented ground materials into a virtual simulation scene was introduced, and visual results are reported in this paper.

READ FULL TEXT

page 6

page 9

page 10

page 11

research
08/09/2020

Fully Automated Photogrammetric Data Segmentation and Object Information Extraction Approach for Creating Simulation Terrain

Our previous works have demonstrated that visually realistic 3D meshes c...
research
08/21/2020

Semantic Segmentation and Data Fusion of Microsoft Bing 3D Cities and Small UAV-based Photogrammetric Data

With state-of-the-art sensing and photogrammetric techniques, Microsoft ...
research
01/07/2022

Development of Automatic Tree Counting Software from UAV Based Aerial Images With Machine Learning

Unmanned aerial vehicles (UAV) are used successfully in many application...
research
08/31/2016

Radiation Search Operations using Scene Understanding with Autonomous UAV and UGV

Autonomously searching for hazardous radiation sources requires the abil...
research
09/22/2020

Differential Viewpoints for Ground Terrain Material Recognition

Computational surface modeling that underlies material recognition has t...
research
09/21/2017

Playing for Benchmarks

We present a benchmark suite for visual perception. The benchmark is bas...

Please sign up or login with your details

Forgot password? Click here to reset