DeepAI
Log In Sign Up

Super-Human Performance in Gran Turismo Sport Using Deep Reinforcement Learning

08/18/2020
by   Florian Fuchs, et al.
15

Autonomous car racing raises fundamental robotics challenges such as planning minimum-time trajectories under uncertain dynamics and controlling the car at its friction limits. In this project, we consider the task of autonomous car racing in the top-selling car racing game Gran Turismo Sport. Gran Turismo Sport is known for its detailed physics simulation of various cars and tracks. Our approach makes use of maximum-entropy deep reinforcement learning and a new reward design to train a sensorimotor policy to complete a given race track as fast as possible. We evaluate our approach in three different time trial settings with different cars and tracks. Our results show that the obtained controllers not only beat the built-in non-player character of Gran Turismo Sport, but also outperform the fastest known times in a dataset of personal best lap times of over 50,000 human drivers.

READ FULL TEXT

page 1

page 3

page 5

page 7

03/26/2021

Autonomous Overtaking in Gran Turismo Sport Using Curriculum Reinforcement Learning

Professional race car drivers can execute extreme overtaking maneuvers. ...
12/22/2021

Adversarial Deep Reinforcement Learning for Trustworthy Autonomous Driving Policies

Deep reinforcement learning is widely used to train autonomous cars in a...
04/22/2021

Formula RL: Deep Reinforcement Learning for Autonomous Racing using Telemetry Data

This paper explores the use of reinforcement learning (RL) models for au...
03/15/2021

Autonomous Drone Racing with Deep Reinforcement Learning

In many robotic tasks, such as drone racing, the goal is to travel throu...
12/01/2020

Train Tracks with Gaps: Applying the Probabilistic Method to Trains

We identify a tradeoff curve between the number of wheels on a train car...
10/09/2018

Distributed Wildfire Surveillance with Autonomous Aircraft using Deep Reinforcement Learning

Teams of autonomous unmanned aircraft can be used to monitor wildfires, ...
10/11/2021

Autonomous Racing using a Hybrid Imitation-Reinforcement Learning Architecture

In this work, we present a rigorous end-to-end control strategy for auto...