LiDAR guided Small obstacle Segmentation

03/12/2020
by   Aasheesh Singh, et al.
0

Detecting small obstacles on the road is critical for autonomous driving. In this paper, we present a method to reliably detect such obstacles through a multi-modal framework of sparse LiDAR(VLP-16) and Monocular vision. LiDAR is employed to provide additional context in the form of confidence maps to monocular segmentation networks. We show significant performance gains when the context is fed as an additional input to monocular semantic segmentation frameworks. We further present a new semantic segmentation dataset to the community, comprising of over 3000 image frames with corresponding LiDAR observations. The images come with pixel-wise annotations of three classes off-road, road, and small obstacle. We stress that precise calibration between LiDAR and camera is crucial for this task and thus propose a novel Hausdorff distance based calibration refinement method over extrinsic parameters. As a first benchmark over this dataset, we report our results with 73 detection up to a distance of 50 meters on challenging scenarios. Qualitatively by showcasing accurate segmentation of obstacles less than 15 cms at 50m depth and quantitatively through favourable comparisons vis a vis prior art, we vindicate the method's efficacy. Our project-page and Dataset is hosted at https://small-obstacle-dataset.github.io/

READ FULL TEXT

page 1

page 2

page 3

page 4

page 5

page 8

research
09/15/2016

Lost and Found: Detecting Small Road Hazards for Self-Driving Vehicles

Detecting small obstacles on the road ahead is a critical part of the dr...
research
07/08/2022

BlindSpotNet: Seeing Where We Cannot See

We introduce 2D blind spot estimation as a critical visual task for road...
research
04/23/2019

A Novel Multi-layer Framework for Tiny Obstacle Discovery

For tiny obstacle discovery in a monocular image, edge is a fundamental ...
research
12/25/2020

Detecting Road Obstacles by Erasing Them

Vehicles can encounter a myriad of obstacles on the road, and it is not ...
research
03/17/2018

MergeNet: A Deep Net Architecture for Small Obstacle Discovery

We present here, a novel network architecture called MergeNet for discov...
research
08/30/2019

Small Obstacle Avoidance Based on RGB-D Semantic Segmentation

This paper presents a novel obstacle avoidance system for road robots eq...
research
08/18/2023

LaRS: A Diverse Panoptic Maritime Obstacle Detection Dataset and Benchmark

The progress in maritime obstacle detection is hindered by the lack of a...

Please sign up or login with your details

Forgot password? Click here to reset