A LiDAR Point Cloud Generator: from a Virtual World to Autonomous Driving

03/31/2018
by   Xiangyu Yue, et al.
0

3D LiDAR scanners are playing an increasingly important role in autonomous driving as they can generate depth information of the environment. However, creating large 3D LiDAR point cloud datasets with point-level labels requires a significant amount of manual annotation. This jeopardizes the efficient development of supervised deep learning algorithms which are often data-hungry. We present a framework to rapidly create point clouds with accurate point-level labels from a computer game. The framework supports data collection from both auto-driving scenes and user-configured scenes. Point clouds from auto-driving scenes can be used as training data for deep learning algorithms, while point clouds from user-configured scenes can be used to systematically test the vulnerability of a neural network, and use the falsifying examples to make the neural network more robust through retraining. In addition, the scene images can be captured simultaneously in order for sensor fusion tasks, with a method proposed to do automatic calibration between the point clouds and captured scene images. We show a significant improvement in accuracy (+9 cloud segmentation by augmenting the training dataset with the generated synthesized data. Our experiments also show by testing and retraining the network using point clouds from user-configured scenes, the weakness/blind spots of the neural network can be fixed.

READ FULL TEXT

page 2

page 4

page 5

research
04/28/2023

NeRF-LiDAR: Generating Realistic LiDAR Point Clouds with Neural Radiance Fields

Labeling LiDAR point clouds for training autonomous driving is extremely...
research
01/22/2021

Machine Learning in LiDAR 3D point clouds

LiDAR point clouds contain measurements of complicated natural scenes an...
research
07/30/2021

Pix2Point: Learning Outdoor 3D Using Sparse Point Clouds and Optimal Transport

Good quality reconstruction and comprehension of a scene rely on 3D esti...
research
04/14/2022

Interactive Object Segmentation in 3D Point Clouds

Deep learning depends on large amounts of labeled training data. Manual ...
research
06/26/2019

Large-scale 3D point cloud representations via graph inception networks with applications to autonomous driving

We present a novel graph-neural-network-based system to effectively repr...
research
05/01/2019

Precise Synthetic Image and LiDAR (PreSIL) Dataset for Autonomous Vehicle Perception

We introduce the Precise Synthetic Image and LiDAR (PreSIL) dataset for ...
research
12/15/2016

Cloud Dictionary: Sparse Coding and Modeling for Point Clouds

With the development of range sensors such as LIDAR and time-of-flight c...

Please sign up or login with your details

Forgot password? Click here to reset