Deep Learning for Image and Point Cloud Fusion in Autonomous Driving: A Review

04/10/2020
by   Yaodong Cui, et al.
24

Autonomous vehicles are experiencing rapid development in the past few years. However, achieving full autonomy is not a trivial task, due to the nature of the complex and dynamic driving environment. Therefore, autonomous vehicles are equipped with a suite of different sensors to ensure robust, accurate environmental perception. In particular, camera-LiDAR fusion is becoming an emerging research theme. However, so far there is no critical review that focuses on deep-learning-based camera-LiDAR fusion methods. To bridge this gap and motivate future research, this paper devotes to review recent deep-learning-based data fusion approaches that leverage both image and point cloud. This review gives a brief overview of deep learning on image and point cloud data processing. Followed by in-depth reviews of camera-LiDAR fusion methods in depth completion, object detection, semantic segmentation and tracking, which are organized based on their respective fusion levels. Furthermore, we compare these methods on publicly available datasets. Finally, we identified gaps and over-looked challenges between current academic researches and real-world applications. Based on these observations, we provide our insights and point out promising research directions.

READ FULL TEXT

page 1

page 2

page 14

research
04/20/2023

Radar-Camera Fusion for Object Detection and Semantic Segmentation in Autonomous Driving: A Comprehensive Review

Driven by deep learning techniques, perception technology in autonomous ...
research
05/19/2023

RGB-D And Thermal Sensor Fusion: A Systematic Literature Review

In the last decade, the computer vision field has seen significant progr...
research
06/24/2021

Multi-Modal 3D Object Detection in Autonomous Driving: a Survey

In the past few years, we have witnessed rapid development of autonomous...
research
09/15/2021

Sequential Point Cloud Prediction in Interactive Scenarios: A Survey

Point cloud has been widely used in the field of autonomous driving sinc...
research
08/03/2020

LiDAR point-cloud processing based on projection methods: a comparison

An accurate and rapid-response perception system is fundamental for auto...
research
02/22/2022

3D ToF LiDAR in Mobile Robotics: A Review

In the past ten years, the use of 3D Time-of-Flight (ToF) LiDARs in mobi...
research
05/24/2017

VANETs Meet Autonomous Vehicles: A Multimodal 3D Environment Learning Approach

In this paper, we design a multimodal framework for object detection, re...

Please sign up or login with your details

Forgot password? Click here to reset