Elevation Estimation-Driven Building 3D Reconstruction from Single-View Remote Sensing Imagery

01/11/2023
by   Yongqiang Mao, et al.
4

Building 3D reconstruction from remote sensing images has a wide range of applications in smart cities, photogrammetry and other fields. Methods for automatic 3D urban building modeling typically employ multi-view images as input to algorithms to recover point clouds and 3D models of buildings. However, such models rely heavily on multi-view images of buildings, which are time-intensive and limit the applicability and practicality of the models. To solve these issues, we focus on designing an efficient DSM estimation-driven reconstruction framework (Building3D), which aims to reconstruct 3D building models from the input single-view remote sensing image. First, we propose a Semantic Flow Field-guided DSM Estimation (SFFDE) network, which utilizes the proposed concept of elevation semantic flow to achieve the registration of local and global features. Specifically, in order to make the network semantics globally aware, we propose an Elevation Semantic Globalization (ESG) module to realize the semantic globalization of instances. Further, in order to alleviate the semantic span of global features and original local features, we propose a Local-to-Global Elevation Semantic Registration (L2G-ESR) module based on elevation semantic flow. Our Building3D is rooted in the SFFDE network for building elevation prediction, synchronized with a building extraction network for building masks, and then sequentially performs point cloud reconstruction, surface reconstruction (or CityGML model reconstruction). On this basis, our Building3D can optionally generate CityGML models or surface mesh models of the buildings. Extensive experiments on ISPRS Vaihingen and DFC2019 datasets on the DSM estimation task show that our SFFDE significantly improves upon state-of-the-arts. Furthermore, our Building3D achieves impressive results in the 3D point cloud and 3D model reconstruction process.

READ FULL TEXT

page 1

page 4

page 9

page 10

page 11

page 12

page 13

page 14

research
09/12/2023

Feature Aggregation Network for Building Extraction from High-resolution Remote Sensing Images

The rapid advancement in high-resolution satellite remote sensing data a...
research
12/13/2021

Local and Global Point Cloud Reconstruction for 3D Hand Pose Estimation

This paper addresses the 3D point cloud reconstruction and 3D pose estim...
research
08/25/2022

Learning to Construct 3D Building Wireframes from 3D Line Clouds

Line clouds, though under-investigated in the previous work, potentially...
research
11/07/2018

GeoSay: A Geometric Saliency for Extracting Buildings in Remote Sensing Images

Automatic extraction of buildings in remote sensing images is an importa...
research
07/23/2023

Building-road Collaborative Extraction from Remotely Sensed Images via Cross-Interaction

Buildings are the basic carrier of social production and human life; roa...
research
06/04/2018

Accurate Building Detection in VHR Remote Sensing Images using Geometric Saliency

This paper aims to address the problem of detecting buildings from remot...
research
03/22/2020

Curved Buildings Reconstruction from Airborne LiDAR Data by Matching and Deforming Geometric Primitives

Airborne LiDAR (Light Detection and Ranging) data is widely applied in b...

Please sign up or login with your details

Forgot password? Click here to reset