Deep Representation Learning for Road Detection through Siamese Network

05/26/2019
by   Huafeng Liu, et al.
0

Robust road detection is a key challenge in safe autonomous driving. Recently, with the rapid development of 3D sensors, more and more researchers are trying to fuse information across different sensors to improve the performance of road detection. Although many successful works have been achieved in this field, methods for data fusion under deep learning framework is still an open problem. In this paper, we propose a Siamese deep neural network based on FCN-8s to detect road region. Our method uses data collected from a monocular color camera and a Velodyne-64 LiDAR sensor. We project the LiDAR point clouds onto the image plane to generate LiDAR images and feed them into one of the branches of the network. The RGB images are fed into another branch of our proposed network. The feature maps that these two branches extract in multiple scales are fused before each pooling layer, via padding additional fusion layers. Extensive experimental results on public dataset KITTI ROAD demonstrate the effectiveness of our proposed approach.

READ FULL TEXT

page 5

page 11

page 12

research
09/21/2018

LIDAR-Camera Fusion for Road Detection Using Fully Convolutional Neural Networks

In this work, a deep learning approach has been developed to carry out r...
research
05/02/2023

FlowMap: Path Generation for Automated Vehicles in Open Space Using Traffic Flow

There is extensive literature on perceiving road structures by fusing va...
research
01/03/2020

Deep Unsupervised Common Representation Learning for LiDAR and Camera Data using Double Siamese Networks

Domain gaps of sensor modalities pose a challenge for the design of auto...
research
05/26/2019

Road Segmentation with Image-LiDAR Data Fusion

Robust road segmentation is a key challenge in self-driving research. Th...
research
02/22/2022

Enabling Efficient Deep Convolutional Neural Network-based Sensor Fusion for Autonomous Driving

Autonomous driving demands accurate perception and safe decision-making....
research
05/14/2022

Multi-modal curb detection and filtering

Reliable knowledge of road boundaries is critical for autonomous vehicle...
research
04/02/2019

Progressive LiDAR Adaptation for Road Detection

Despite rapid developments in visual image-based road detection, robustl...

Please sign up or login with your details

Forgot password? Click here to reset