DeepAI AI Chat
Log In Sign Up

Multi-Agent Path Planning based on MPC and DDPG

by   Junxiao Xue, et al.

The problem of mixed static and dynamic obstacle avoidance is essential for path planning in highly dynamic environment. However, the paths formed by grid edges can be longer than the true shortest paths in the terrain since their headings are artificially constrained. Existing methods can hardly deal with dynamic obstacles. To address this problem, we propose a new algorithm combining Model Predictive Control (MPC) with Deep Deterministic Policy Gradient (DDPG). Firstly, we apply the MPC algorithm to predict the trajectory of dynamic obstacles. Secondly, the DDPG with continuous action space is designed to provide learning and autonomous decision-making capability for robots. Finally, we introduce the idea of the Artificial Potential Field to set the reward function to improve convergence speed and accuracy. We employ Unity 3D to perform simulation experiments in highly uncertain environment such as aircraft carrier decks and squares. The results show that our method has made great improvement on accuracy by 7 the length of the path and turning angle by reducing 100 units and 400-450 degrees compared with DQN (Deep Q Network), respectively.


page 3

page 4


Model predictive approach to integrated path planning and tracking for autonomous vehicles

In the path planning problem of autonomous application, the existing stu...

Multi-Agent Goal Assignment with Finite-Time Path Planning

Minimising the longest travel distance for a group of mobile robots with...

A Reinforcement Learning based Path Planning Approach in 3D Environment

Optimal trajectory planning involves obstacles avoidance in which path p...

Theta*: Any-Angle Path Planning on Grids

Grids with blocked and unblocked cells are often used to represent terra...

UAV Path Planning Employing MPC- Reinforcement Learning Method for search and rescue mission

In this paper, we tackle the problem of Unmanned Aerial (UA V) path plan...

A Circle Grid-based Approach for Obstacle Avoidance Motion Planning of Unmanned Surface Vehicles

Aiming at an obstacle avoidance problem with dynamic constraints for Unm...

Towards Time-Optimal Any-Angle Path Planning With Dynamic Obstacles

Path finding is a well-studied problem in AI, which is often framed as g...