DeepAI AI Chat
Log In Sign Up

Adversarial Inverse Reinforcement Learning for Decision Making in Autonomous Driving

by   Pin Wang, et al.
Peking University

Generative Adversarial Imitation Learning (GAIL) is an efficient way to learn sequential control strategies from demonstration. Adversarial Inverse Reinforcement Learning (AIRL) is similar to GAIL but also learns a reward function at the same time and has better training stability. In previous work, however, AIRL has mostly been demonstrated on robotic control in artificial environments. In this paper, we apply AIRL to a practical and challenging problem – the decision-making in autonomous driving, and also augment AIRL with a semantic reward to improve its performance. We use four metrics to evaluate its learning performance in a simulated driving environment. Results show that the vehicle agent can learn decent decision-making behaviors from scratch, and can reach a level of performance comparable with that of an expert. Additionally, the comparison with GAIL shows that AIRL converges faster, achieves better and more stable performance than GAIL.


Generative Adversarial Imitation Learning for End-to-End Autonomous Driving on Urban Environments

Autonomous driving is a complex task, which has been tackled since the f...

A New Approach to Training Multiple Cooperative Agents for Autonomous Driving

Training multiple agents to perform safe and cooperative control in the ...

Gradient Optimization for Single-State RMDPs

As modern problems such as autonomous driving, control of robotic compon...

Adaptive Behavior Generation for Autonomous Driving using Deep Reinforcement Learning with Compact Semantic States

Making the right decision in traffic is a challenging task that is highl...

Using Counterfactual Reasoning and Reinforcement Learning for Decision-Making in Autonomous Driving

In decision-making for autonomous vehicles, we need to predict other veh...

Understanding Human Behaviors in Crowds by Imitating the Decision-Making Process

Crowd behavior understanding is crucial yet challenging across a wide ra...