Cone Detection using a Combination of LiDAR and Vision-based Machine Learning

by   Nico Messikommer, et al.

The classification and the position estimation of objects become more and more relevant as the field of robotics is expanding in diverse areas of society. In this Bachelor Thesis, we developed a cone detection algorithm for an autonomous car using a LiDAR sensor and a colour camera. By evaluating simple constraints, the LiDAR detection algorithm preselects cone candidates in the 3 dimensional space. The candidates are projected into the image plane of the colour camera and an image candidate is cropped out. A convolutional neural networks classifies the image candidates as cone or not a cone. With the fusion of the precise position estimation of the LiDAR sensor and the high classification accuracy of a neural network, a reliable cone detection algorithm was implemented. Furthermore, a path planning algorithm generates a path around the detected cones. The final system detects cones even at higher velocity and has the potential to drive fully autonomous around the cones.


page 10

page 12

page 14

page 16

page 19

page 27

page 29

page 31


Autonomous Vehicle Navigation with LIDAR using Path Planning

In this paper, a complete framework for Autonomous Self Driving is imple...

CLOCs: Camera-LiDAR Object Candidates Fusion for 3D Object Detection

There have been significant advances in neural networks for both 3D obje...

Estimation of Closest In-Path Vehicle (CIPV) by Low-Channel LiDAR and Camera Sensor Fusion for Autonomous Vehicle

In autonomous driving, using a variety of sensors to recognize preceding...

LIDAR-Camera Fusion for Road Detection Using Fully Convolutional Neural Networks

In this work, a deep learning approach has been developed to carry out r...

Extrinsic Calibration of a 3D-LIDAR and a Camera

This work presents an extrinsic parameter estimation algorithm between a...

Occupancy Grid Based Reactive Planner

This paper proposes a perception and path planning pipeline for autonomo...

Please sign up or login with your details

Forgot password? Click here to reset