Maneuver Control based on Reinforcement Learning for Automated Vehicles in An Interactive Environment

by   Pin Wang, et al.

Operating a robot safely and efficiently can be considerably challenging in an interactive and complex environment. Other surrounding agents may be cooperative or adversarial in their interactions with the robot. It will be desirable to develop control strategies that can enable the robot agent to handle diverse situations and respond with appropriate behaviors in an interactive environment. In this paper, we focus on automated vehicles, and propose a reinforcement learning based approach to train the vehicle agent for safe, comfortable, and efficient maneuvers under interactive driving situations. Particularly, we design a form of the Q-function approximator that consists of neural networks but also has a closed-form greedy policy. In this way, we avoid the complication of invoking an additional function that learns to take actions, as in actor-critic algorithms. Additionally, we formulate the vehicle control maneuvers with continuous state and action space to enhance the practicability and feasibility of the proposed approach. We test our algorithm in simulation with a challenging use case, the lane change maneuver. Results show that the vehicle robot successfully learns a desirable driving policy that allows it to drive safely, comfortably, and efficiently in complex driving scenarios.



page 1

page 2

page 3

page 4


A Reinforcement Learning Based Approach for Automated Lane Change Maneuvers

Lane change is a crucial vehicle maneuver which needs coordination with ...

Quadratic Q-network for Learning Continuous Control for Autonomous Vehicles

Reinforcement Learning algorithms have recently been proposed to learn t...

Cooperative Highway Work Zone Merge Control based on Reinforcement Learning in A Connected and Automated Environment

Given the aging infrastructure and the anticipated growing number of hig...

Autonomous Ramp Merge Maneuver Based on Reinforcement Learning with Continuous Action Space

Ramp merging is a critical maneuver for road safety and traffic efficien...

Can an AI agent hit a moving target?

As the economies we live in are evolving over time, it is imperative tha...

Learning Partially Structured Environmental Dynamics for Marine Robotic Navigation

We investigate the scenario that a robot needs to reach a designated goa...

Learned and Controlled Autonomous Robotic Exploration in an Extreme, Unknown Environment

Exploring and traversing extreme terrain with surface robots is difficul...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.