DeepAI AI Chat
Log In Sign Up

A Survey of Deep RL and IL for Autonomous Driving Policy Learning

01/06/2021
by   Zeyu Zhu, et al.
0

Autonomous driving (AD) agents generate driving policies based on online perception results, which are obtained at multiple levels of abstraction, e.g., behavior planning, motion planning and control. Driving policies are crucial to the realization of safe, efficient and harmonious driving behaviors, where AD agents still face substantial challenges in complex scenarios. Due to their successful application in fields such as robotics and video games, the use of deep reinforcement learning (DRL) and deep imitation learning (DIL) techniques to derive AD policies have witnessed vast research efforts in recent years. This paper is a comprehensive survey of this body of work, which is conducted at three levels: First, a taxonomy of the literature studies is constructed from the system perspective, among which five modes of integration of DRL/DIL models into an AD architecture are identified. Second, the formulations of DRL/DIL models for conducting specified AD tasks are comprehensively reviewed, where various designs on the model state and action spaces and the reinforcement learning rewards are covered. Finally, an in-depth review is conducted on how the critical issues of AD applications regarding driving safety, interaction with other traffic participants and uncertainty of the environment are addressed by the DRL/DIL models. To the best of our knowledge, this is the first survey to focus on AD policy learning using DRL/DIL, which is addressed simultaneously from the system, task-driven and problem-driven perspectives. We share and discuss findings, which may lead to the investigation of various topics in the future.

READ FULL TEXT

page 1

page 6

page 7

page 11

02/13/2023

Review of Deep Reinforcement Learning for Autonomous Driving

Since deep neural networks' resurgence, reinforcement learning has gradu...
01/06/2019

Exploring applications of deep reinforcement learning for real-world autonomous driving systems

Deep Reinforcement Learning (DRL) has become increasingly powerful in re...
01/30/2020

Survey of Deep Reinforcement Learning for Motion Planning of Autonomous Vehicles

Academic research in the field of autonomous vehicles has reached high p...
12/12/2017

Simulated Autonomous Driving on Realistic Road Networks using Deep Reinforcement Learning

Using Deep Reinforcement Learning (DRL) can be a promising approach to h...
01/20/2021

Shielding Atari Games with Bounded Prescience

Deep reinforcement learning (DRL) is applied in safety-critical domains ...
04/24/2019

How You Act Tells a Lot: Privacy-Leakage Attack on Deep Reinforcement Learning

Machine learning has been widely applied to various applications, some o...
06/03/2022

GINK: Graph-based Interaction-aware Kinodynamic Planning via Reinforcement Learning for Autonomous Driving

There are many challenges in applying deep reinforcement learning (DRL) ...