Multi-vehicle Flocking Control with Deep Deterministic Policy Gradient Method

06/01/2018

∙

Flocking control has been studied extensively along with the wide application of multi-vehicle systems. In this paper the Multi-vehicles System (MVS) flocking control with collision avoidance and communication preserving is considered based on the deep reinforcement learning framework. Specifically the deep deterministic policy gradient (DDPG) with centralized training and distributed execution process is implemented to obtain the flocking control policy. First, to avoid the dynamically changed observation of state, a three layers tensor based representation of the observation is used so that the state remains constant although the observation dimension is changing. A reward function is designed to guide the way-points tracking, collision avoidance and communication preserving. The reward function is augmented by introducing the local reward function of neighbors. Finally, a centralized training process which trains the shared policy based on common training set among all agents. The proposed method is tested under simulated scenarios with different setup.

READ FULL TEXT

Multi-vehicle Flocking Control with Deep Deterministic Policy Gradient Method

Reinforcement learning reward function in unmanned aerial vehicle control tasks

Vehicles Control: Collision Avoidance using Federated Deep Reinforcement Learning

Autonomous Braking System via Deep Reinforcement Learning

Deep Reinforcement Learning for Continuous Docking Control of Autonomous Underwater Vehicles: A Benchmarking Study

Hybrid Car-Following Strategy based on Deep Deterministic Policy Gradient and Cooperative Adaptive Cruise Control

Accelerated Sim-to-Real Deep Reinforcement Learning: Learning Collision Avoidance from Human Player

Smooth Trajectory Collision Avoidance through Deep Reinforcement Learning

Multi-vehicle Flocking Control with Deep Deterministic Policy Gradient Method

Related Research

Reinforcement learning reward function in unmanned aerial vehicle control tasks

Vehicles Control: Collision Avoidance using Federated Deep Reinforcement Learning

Autonomous Braking System via Deep Reinforcement Learning

Deep Reinforcement Learning for Continuous Docking Control of Autonomous Underwater Vehicles: A Benchmarking Study

Hybrid Car-Following Strategy based on Deep Deterministic Policy Gradient and Cooperative Adaptive Cruise Control

Accelerated Sim-to-Real Deep Reinforcement Learning: Learning Collision Avoidance from Human Player

Smooth Trajectory Collision Avoidance through Deep Reinforcement Learning