Dynamic Fusion Module Evolves Drivable Area and Road Anomaly Detection: A Benchmark and Algorithms

03/03/2021
by   Hengli Wang, et al.
0

Joint detection of drivable areas and road anomalies is very important for mobile robots. Recently, many semantic segmentation approaches based on convolutional neural networks (CNNs) have been proposed for pixel-wise drivable area and road anomaly detection. In addition, some benchmark datasets, such as KITTI and Cityscapes, have been widely used. However, the existing benchmarks are mostly designed for self-driving cars. There lacks a benchmark for ground mobile robots, such as robotic wheelchairs. Therefore, in this paper, we first build a drivable area and road anomaly detection benchmark for ground mobile robots, evaluating the existing state-of-the-art single-modal and data-fusion semantic segmentation CNNs using six modalities of visual features. Furthermore, we propose a novel module, referred to as the dynamic fusion module (DFM), which can be easily deployed in existing data-fusion networks to fuse different types of visual features effectively and efficiently. The experimental results show that the transformed disparity image is the most informative visual feature and the proposed DFM-RTFNet outperforms the state-of-the-arts. Additionally, our DFM-RTFNet achieves competitive performance on the KITTI road benchmark. Our benchmark is publicly available at https://sites.google.com/view/gmrb.

READ FULL TEXT

page 1

page 2

page 3

page 5

page 8

page 9

page 10

research
08/26/2020

Applying Surface Normal Information in Drivable Area and Road Anomaly Detection for Ground Mobile Robots

The joint detection of drivable areas and road anomalies is a crucial ta...
research
09/06/2021

Graph Attention Layer Evolves Semantic Segmentation for Road Pothole Detection: A Benchmark and Algorithms

Existing road pothole detection approaches can be classified as computer...
research
12/24/2021

Multi-Scale Feature Fusion: Learning Better Semantic Segmentation for Road Pothole Detection

This paper presents a novel pothole detection approach based on single-m...
research
08/16/2020

We Learn Better Road Pothole Detection: from Attention Aggregation to Adversarial Domain Adaptation

Manual visual inspection performed by certified inspectors is still the ...
research
07/12/2020

Self-Supervised Drivable Area and Road Anomaly Segmentation using RGB-D Data for Robotic Wheelchairs

The segmentation of drivable areas and road anomalies are critical capab...
research
04/18/2020

BiFNet: Bidirectional Fusion Network for Road Segmentation

Multi-sensor fusion-based road segmentation plays an important role in t...
research
04/02/2019

Progressive LiDAR Adaptation for Road Detection

Despite rapid developments in visual image-based road detection, robustl...

Please sign up or login with your details

Forgot password? Click here to reset