DeepAI AI Chat
Log In Sign Up

Interpretable End-to-end Urban Autonomous Driving with Latent Deep Reinforcement Learning

01/23/2020
by   Jianyu Chen, et al.
38

Unlike popular modularized framework, end-to-end autonomous driving seeks to solve the perception, decision and control problems in an integrated way, which can be more adapting to new scenarios and easier to generalize at scale. However, existing end-to-end approaches are often lack of interpretability, and can only deal with simple driving tasks like lane keeping. In this paper, we propose an interpretable deep reinforcement learning method for end-to-end autonomous driving, which is able to handle complex urban scenarios. A sequential latent environment model is introduced and learned jointly with the reinforcement learning process. With this latent model, a semantic birdeye mask can be generated, which is enforced to connect with a certain intermediate property in today's modularized framework for the purpose of explaining the behaviors of learned policy. The latent space also significantly reduces the sample complexity of reinforcement learning. Comparison tests with a simulated autonomous car in CARLA show that the performance of our method in urban scenarios with crowded surrounding vehicles dominates many baselines including DQN, DDPG, TD3 and SAC. Moreover, through masked outputs, the learned policy is able to provide a better explanation of how the car reasons about the driving environment.

READ FULL TEXT

page 1

page 5

page 7

page 9

page 10

page 11

04/20/2019

Model-free Deep Reinforcement Learning for Urban Autonomous Driving

Urban autonomous driving decision making is challenging due to complex r...
03/21/2020

End-to-end Autonomous Driving Perception with Sequential Latent Representation Learning

Current autonomous driving systems are composed of a perception system a...
10/02/2021

Cycle-Consistent World Models for Domain Independent Latent Imagination

End-to-end autonomous driving seeks to solve the perception, decision, a...
02/17/2022

CADRE: A Cascade Deep Reinforcement Learning Framework for Vision-based Autonomous Urban Driving

Vision-based autonomous urban driving in dense traffic is quite challeng...
04/02/2019

Finding and Visualizing Weaknesses of Deep Reinforcement Learning Agents

As deep reinforcement learning driven by visual perception becomes more ...
04/08/2017

Deep Reinforcement Learning framework for Autonomous Driving

Reinforcement learning is considered to be a strong AI paradigm which ca...
05/16/2019

Autonomous Vehicle Control: End-to-end Learning in Simulated Urban Environments

In recent years, considerable progress has been made towards a vehicle's...

Code Repositories

gym-carla

An OpenAI gym wrapper for CARLA simulator


view repo

interp-e2e-driving

Interpretable End-to-end Urban Autonomous Driving with Latent Deep Reinforcement Learning


view repo