Progressive LiDAR Adaptation for Road Detection

04/02/2019
by   Zhe Chen, et al.
0

Despite rapid developments in visual image-based road detection, robustly identifying road areas in visual images remains challenging due to issues like illumination changes and blurry images. To this end, LiDAR sensor data can be incorporated to improve the visual image-based road detection, because LiDAR data is less susceptible to visual noises. However, the main difficulty in introducing LiDAR information into visual image-based road detection is that LiDAR data and its extracted features do not share the same space with the visual data and visual features. Such gaps in spaces may limit the benefits of LiDAR information for road detection. To overcome this issue, we introduce a novel Progressive LiDAR Adaptation-aided Road Detection (PLARD) approach to adapt LiDAR information into visual image-based road detection and improve detection performance. In PLARD, progressive LiDAR adaptation consists of two subsequent modules: 1) data space adaptation, which transforms the LiDAR data to the visual data space to align with the perspective view by applying altitude difference-based transformation; and 2) feature space adaptation, which adapts LiDAR features to visual features through a cascaded fusion structure. Comprehensive empirical studies on the well-known KITTI road detection benchmark demonstrate that PLARD takes advantage of both the visual and LiDAR information, achieving much more robust road detection even in challenging urban scenes. In particular, PLARD outperforms other state-of-the-art road detection models and is currently top of the publicly accessible benchmark leader-board.

READ FULL TEXT

page 1

page 4

page 8

research
05/26/2019

Road Segmentation with Image-LiDAR Data Fusion

Robust road segmentation is a key challenge in self-driving research. Th...
research
04/18/2020

BiFNet: Bidirectional Fusion Network for Road Segmentation

Multi-sensor fusion-based road segmentation plays an important role in t...
research
07/28/2021

Pseudo-LiDAR Based Road Detection

Road detection is a critically important task for self-driving cars. By ...
research
05/26/2019

Deep Representation Learning for Road Detection through Siamese Network

Robust road detection is a key challenge in safe autonomous driving. Rec...
research
09/21/2018

LIDAR-Camera Fusion for Road Detection Using Fully Convolutional Neural Networks

In this work, a deep learning approach has been developed to carry out r...
research
03/03/2021

Dynamic Fusion Module Evolves Drivable Area and Road Anomaly Detection: A Benchmark and Algorithms

Joint detection of drivable areas and road anomalies is very important f...
research
06/20/2022

ORFD: A Dataset and Benchmark for Off-Road Freespace Detection

Freespace detection is an essential component of autonomous driving tech...

Please sign up or login with your details

Forgot password? Click here to reset