Sim-To-Real Transfer for Miniature Autonomous Car Racing

11/11/2020
by   Yeong-Jia Roger Chu, et al.
14

Sim-to-real, a term that describes where a model is trained in a simulator then transferred to the real world, is a technique that enables faster deep reinforcement learning (DRL) training. However, differences between the simulator and the real world often cause the model to perform poorly in the real world. Domain randomization is a way to bridge the sim-to-real gap by exposing the model to a wide range of scenarios so that it can generalize to real-world situations. However, following domain randomization to train an autonomous car racing model with DRL can lead to undesirable outcomes. Namely, a model trained with randomization tends to run slower; a higher completion rate on the testing track comes at the expense of longer lap times. This paper aims to boost the robustness of a trained race car model without compromising racing lap times. For a training track and a testing track having the same shape (and same optimal paths), but with different lighting, background, etc., we first train a model (teacher model) that overfits the training track, moving along a near optimal path. We then use this model to teach a student model the correct actions along with randomization. With our method, a model with 18.4% completion rate on the testing track is able to help teach a student model with 52% completion. Moreover, over an average of 50 trials, the student is able to finish a lap 0.23 seconds faster than the teacher. This 0.23 second gap is significant in tight races, with lap times of about 10 to 12 seconds.

READ FULL TEXT
research
09/23/2020

Robust Reinforcement Learning-based Autonomous Driving Agent for Simulation and Real World

Deep Reinforcement Learning (DRL) has been successfully used to solve di...
research
11/26/2020

Learning from Simulation, Racing in Reality

We present a reinforcement learning-based solution to autonomously race ...
research
07/25/2021

DR2L: Surfacing Corner Cases to Robustify Autonomous Driving via Domain Randomization Reinforcement Learning

How to explore corner cases as efficiently and thoroughly as possible ha...
research
12/01/2020

Train Tracks with Gaps: Applying the Probabilistic Method to Trains

We identify a tradeoff curve between the number of wheels on a train car...
research
10/07/2021

Understanding Domain Randomization for Sim-to-real Transfer

Reinforcement learning encounters many challenges when applied directly ...
research
05/16/2022

Bridging Sim2Real Gap Using Image Gradients for the Task of End-to-End Autonomous Driving

We present the first prize solution to NeurIPS 2021 - AWS Deepracer Chal...
research
09/06/2023

Active shooter detection and robust tracking utilizing supplemental synthetic data

The increasing concern surrounding gun violence in the United States has...

Please sign up or login with your details

Forgot password? Click here to reset