Deep Learning and Control Algorithms of Direct Perception for Autonomous Driving

by   Der-Hau Lee, et al.

Based on the direct perception paradigm of autonomous driving, we investigate and modify the CNNs (convolutional neural networks) AlexNet and GoogLeNet that map an input image to few perception indicators (heading angle, distances to preceding cars, and distance to road centerline) for estimating driving affordances in highway traffic. We also design a controller with these indicators and the short-range sensor information of TORCS (the open racing car simulator) for driving simulated cars to avoid collisions. We collect a set of images from a TORCS camera in various driving scenarios, train these CNNs using the dataset, test them in unseen traffics, and find that they perform better than earlier algorithms and controllers in terms of training loss and driving stability. Source code and data are available on our website.



There are no comments yet.


page 2


DeepDriving: Learning Affordance for Direct Perception in Autonomous Driving

Today, there are two major paradigms for vision-based autonomous driving...

Feature Analysis and Selection for Training an End-to-End Autonomous Vehicle Controller Using the Deep Learning Approach

Deep learning-based approaches have been widely used for training contro...

Towards Robust Direct Perception Networks for Automated Driving

We consider the problem of engineering robust direct perception neural n...

Affordance Learning In Direct Perception for Autonomous Driving

Recent development in autonomous driving involves high-level computer vi...

End to End Vehicle Lateral Control Using a Single Fisheye Camera

Convolutional neural networks are commonly used to control the steering ...

Bio-Inspired Foveated Technique for Augmented-Range Vehicle Detection Using Deep Neural Networks

We propose a bio-inspired foveated technique to detect cars in a long ra...

Pedestrian Emergence Estimation and Occlusion-Aware Risk Assessment for Urban Autonomous Driving

Avoiding unseen or partially occluded vulnerable road users (VRUs) is a ...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.