Beyond Grand Theft Auto V for Training, Testing and Enhancing Deep Learning in Self Driving Cars

12/04/2017
by   Mark Martinez, et al.
0

As an initial assessment, over 480,000 labeled virtual images of normal highway driving were readily generated in Grand Theft Auto V's virtual environment. Using these images, a CNN was trained to detect following distance to cars/objects ahead, lane markings, and driving angle (angular heading relative to lane centerline): all variables necessary for basic autonomous driving. Encouraging results were obtained when tested on over 50,000 labeled virtual images from substantially different GTA-V driving environments. This initial assessment begins to define both the range and scope of the labeled images needed for training as well as the range and scope of labeled images needed for testing the definition of boundaries and limitations of trained networks. It is the efficacy and flexibility of a "GTA-V"-like virtual environment that is expected to provide an efficient well-defined foundation for the training and testing of Convolutional Neural Networks for safe driving. Additionally, described is the Princeton Virtual Environment (PVE) for the training, testing and enhancement of safe driving AI, which is being developed using the video-game engine Unity. PVE is being developed to recreate rare but critical corner cases that can be used in re-training and enhancing machine learning models and understanding the limitations of current self driving models. The Florida Tesla crash is being used as an initial reference.

READ FULL TEXT

page 7

page 8

page 10

page 12

research
09/22/2021

Benchmarking Lane-changing Decision-making for Deep Reinforcement Learning

The development of autonomous driving has attracted extensive attention ...
research
01/13/2021

A Survey on Simulators for Testing Self-Driving Cars

A rigorous and comprehensive testing plays a key role in training self-d...
research
06/30/2017

Failing to Learn: Autonomously Identifying Perception Failures for Self-driving Cars

One of the major open challenges in self-driving cars is the ability to ...
research
08/31/2018

Using a Game Engine to Simulate Critical Incidents and Data Collection by Autonomous Drones

Using a game engine, we have developed a virtual environment which model...
research
04/25/2017

Explaining How a Deep Neural Network Trained with End-to-End Learning Steers a Car

As part of a complete software stack for autonomous driving, NVIDIA has ...
research
08/10/2017

Systematic Testing of Convolutional Neural Networks for Autonomous Driving

We present a framework to systematically analyze convolutional neural ne...
research
02/28/2018

Clustering of Naturalistic Driving Encounters Using Unsupervised Learning

Deep understanding of driving encounters could help self-driving cars ma...

Please sign up or login with your details

Forgot password? Click here to reset