Feature Analysis and Selection for Training an End-to-End Autonomous Vehicle Controller Using the Deep Learning Approach

03/28/2017
by   Shun Yang, et al.
0

Deep learning-based approaches have been widely used for training controllers for autonomous vehicles due to their powerful ability to approximate nonlinear functions or policies. However, the training process usually requires large labeled data sets and takes a lot of time. In this paper, we analyze the influences of features on the performance of controllers trained using the convolutional neural networks (CNNs), which gives a guideline of feature selection to reduce computation cost. We collect a large set of data using The Open Racing Car Simulator (TORCS) and classify the image features into three categories (sky-related, roadside-related, and road-related features).We then design two experimental frameworks to investigate the importance of each single feature for training a CNN controller.The first framework uses the training data with all three features included to train a controller, which is then tested with data that has one feature removed to evaluate the feature's effects. The second framework is trained with the data that has one feature excluded, while all three features are included in the test data. Different driving scenarios are selected to test and analyze the trained controllers using the two experimental frameworks. The experiment results show that (1) the road-related features are indispensable for training the controller, (2) the roadside-related features are useful to improve the generalizability of the controller to scenarios with complicated roadside information, and (3) the sky-related features have limited contribution to train an end-to-end autonomous vehicle controller.

READ FULL TEXT

page 2

page 3

page 5

research
10/26/2019

Deep Learning and Control Algorithms of Direct Perception for Autonomous Driving

Based on the direct perception paradigm of autonomous driving, we invest...
research
02/14/2023

Residual Policy Learning for Vehicle Control of Autonomous Racing Cars

The development of vehicle controllers for autonomous racing is challeng...
research
03/10/2018

A Tutorial On Autonomous Vehicle Steering Controller Design, Simulation and Implementation

In this tutorial, we detailed simple controllers for autonomous parking ...
research
05/13/2018

Spatial Uncertainty Sampling for End-to-End Control

End-to-end trained neural networks (NNs) are a compelling approach to au...
research
04/18/2019

Learning a Controller Fusion Network by Online Trajectory Filtering for Vision-based UAV Racing

Autonomous UAV racing has recently emerged as an interesting research pr...
research
07/21/2021

Training Electric Vehicle Charging Controllers with Imitation Learning

The problem of coordinating the charging of electric vehicles gains more...
research
03/23/2021

Neural Network Controller for Autonomous Pile Loading Revised

We have recently proposed two pile loading controllers that learn from h...

Please sign up or login with your details

Forgot password? Click here to reset