Integrating Imitation Learning with Human Driving Data into Reinforcement Learning to Improve Training Efficiency for Autonomous Driving

11/23/2021
by   Heidi Lu, et al.
0

Two current methods used to train autonomous cars are reinforcement learning and imitation learning. This research develops a new learning methodology and systematic approach in both a simulated and a smaller real world environment by integrating supervised imitation learning into reinforcement learning to make the RL training data collection process more effective and efficient. By combining the two methods, the proposed research successfully leverages the advantages of both RL and IL methods. First, a real mini-scale robot car was assembled and trained on a 6 feet by 9 feet real world track using imitation learning. During the process, a handle controller was used to control the mini-scale robot car to drive on the track by imitating a human expert driver and manually recorded the actions using Microsoft AirSim's API. 331 accurate human-like reward training samples were able to be generated and collected. Then, an agent was trained in the Microsoft AirSim simulator using reinforcement learning for 6 hours with the initial 331 reward data inputted from imitation learning training. After a 6-hour training period, the mini-scale robot car was able to successfully drive full laps around the 6 feet by 9 feet track autonomously while the mini-scale robot car was unable to complete one full lap round the track even after 30 hour training pure RL training. With 80 significantly more average rewards per hour. Thus, the new methodology was able to save a significant amount of training time and can be used to accelerate the adoption of RL in autonomous driving, which would help produce more efficient and better results in the long run when applied to real life scenarios. Key Words: Reinforcement Learning (RL), Imitation Learning (IL), Autonomous Driving, Human Driving Data, CNN

READ FULL TEXT

page 12

page 14

page 15

research
12/21/2022

Imitation Is Not Enough: Robustifying Imitation with Reinforcement Learning for Challenging Driving Scenarios

Imitation learning (IL) is a simple and powerful way to use high-quality...
research
08/03/2020

Learning to Drive Small Scale Cars from Scratch

We consider the problem of learning to drive low-cost small scale cars u...
research
04/19/2023

FastRLAP: A System for Learning High-Speed Driving via Deep RL and Autonomous Practicing

We present a system that enables an autonomous small-scale RC car to dri...
research
12/04/2016

Deep Learning of Robotic Tasks without a Simulator using Strong and Weak Human Supervision

We propose a scheme for training a computerized agent to perform complex...
research
10/14/2019

Federated Transfer Reinforcement Learning for Autonomous Driving

Reinforcement learning (RL) is widely used in autonomous driving tasks a...
research
07/16/2019

Improved Reinforcement Learning through Imitation Learning Pretraining Towards Image-based Autonomous Driving

We present a training pipeline for the autonomous driving task given the...
research
11/25/2020

Experiments in Autonomous Driving Through Imitation Learning

This report demonstrates several methods used to make a self-driving veh...

Please sign up or login with your details

Forgot password? Click here to reset