Multi-Agent Path Planning based on MPC and DDPG

02/26/2021
by   Junxiao Xue, et al.
0

The problem of mixed static and dynamic obstacle avoidance is essential for path planning in highly dynamic environment. However, the paths formed by grid edges can be longer than the true shortest paths in the terrain since their headings are artificially constrained. Existing methods can hardly deal with dynamic obstacles. To address this problem, we propose a new algorithm combining Model Predictive Control (MPC) with Deep Deterministic Policy Gradient (DDPG). Firstly, we apply the MPC algorithm to predict the trajectory of dynamic obstacles. Secondly, the DDPG with continuous action space is designed to provide learning and autonomous decision-making capability for robots. Finally, we introduce the idea of the Artificial Potential Field to set the reward function to improve convergence speed and accuracy. We employ Unity 3D to perform simulation experiments in highly uncertain environment such as aircraft carrier decks and squares. The results show that our method has made great improvement on accuracy by 7 the length of the path and turning angle by reducing 100 units and 400-450 degrees compared with DQN (Deep Q Network), respectively.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 3

page 4

05/09/2019

Model predictive approach to integrated path planning and tracking for autonomous vehicles

In the path planning problem of autonomous application, the existing stu...
05/21/2021

A Reinforcement Learning based Path Planning Approach in 3D Environment

Optimal trajectory planning involves obstacles avoidance in which path p...
01/16/2014

Theta*: Any-Angle Path Planning on Grids

Grids with blocked and unblocked cells are often used to represent terra...
10/26/2019

D-Point Trigonometric Path Planning based on Q-Learning in Uncertain Environments

Finding the optimum path for a robot for moving from start to the goal p...
12/20/2020

Path Planning and Obstacle Avoidance Scheme for Autonomous Robots using Raspberry Pi

With the incremental development of robotic platforms to automate the ma...
09/15/2021

Infusing model predictive control into meta-reinforcement learning for mobile robots in dynamic environments

The successful operation of mobile robots requires them to rapidly adapt...
07/28/2020

Risk-Averse MPC via Visual-Inertial Input and Recurrent Networks for Online Collision Avoidance

In this paper, we propose an online path planning architecture that exte...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.