VPC-Net: Completion of 3D Vehicles from MLS Point Clouds

08/08/2020
by   Yan Xia, et al.
14

Vehicles are the most concerned investigation target as a dynamic and essential component in the road environment of urban scenarios. To monitor their behaviors and extract their geometric characteristics, an accurate and instant measurement of the vehicles plays a vital role in remote sensing and computer vision field. 3D point clouds acquired from the mobile laser scanning (MLS) system deliver 3D information of unprecedented detail of road scenes along with the driving. They have proven to be an adequate data source in the fields of intelligent transportation and autonomous driving, especially for extracting vehicles. However, acquired 3D point clouds of vehicles from MLS systems are inevitably incomplete due to object occlusion or self-occlusion. To tackle this problem, we proposed a neural network to synthesize complete, dense, and uniform point clouds for vehicles from MLS data, named Vehicle Points Completion-Net (VPC-Net). In this network, we introduced a new encoder module to extract global features from the input instance, consisting of a spatial transformer network and point feature enhancement layer. Moreover, a new refiner module is also presented to preserve the vehicle details from inputs and refine the complete outputs with fine-grained information. Given the sparse and partial point clouds of vehicles, the network can generate complete and realistic structures, and keep the fine-grained details from the partial inputs. We evaluated the proposed VPC-Net in different experiments using synthetic and real-scan datasets and applied the results to 3D vehicle monitoring tasks. Quantitative and qualitative experiments demonstrate the promising performance of VPC-Net and show state-of-the-art results.

READ FULL TEXT

page 5

page 8

page 9

page 11

page 13

page 15

page 16

page 18

research
09/01/2021

An Efficient Deep Learning Approach Using Improved Generative Adversarial Networks for Incomplete Information Completion of Self-driving

Autonomous driving is the key technology of intelligent logistics in Ind...
research
04/19/2021

ASFM-Net: Asymmetrical Siamese Feature Matching Network for Point Completion

We tackle the problem of object completion from point clouds and propose...
research
10/17/2020

A Self-supervised Cascaded Refinement Network for Point Cloud Completion

Point clouds are often sparse and incomplete, which imposes difficulties...
research
08/23/2023

Rotation-Invariant Completion Network

Real-world point clouds usually suffer from incompleteness and display d...
research
08/02/2018

PCN: Point Completion Network

Shape completion, the problem of estimating the complete geometry of obj...
research
08/29/2013

A Synergistic Approach for Recovering Occlusion-Free Textured 3D Maps of Urban Facades from Heterogeneous Cartographic Data

In this paper we present a practical approach for generating an occlusio...
research
03/18/2023

Social Occlusion Inference with Vectorized Representation for Autonomous Driving

Autonomous vehicles must be capable of handling the occlusion of the env...

Please sign up or login with your details

Forgot password? Click here to reset