Three-Dimensional Trajectory Design for Multi-User MISO UAV Communications: A Deep Reinforcement Learning Approach

08/02/2021
by   Yang Wang, et al.
0

In this paper, we investigate a multi-user downlink multiple-input single-output (MISO) unmanned aerial vehicle (UAV) communication system, where a multi-antenna UAV is employed to serve multiple ground terminals. Unlike existing approaches focus only on a simplified two-dimensional scenario, this paper considers a three-dimensional (3D) urban environment, where the UAV's 3D trajectory is designed to minimize data transmission completion time subject to practical throughput and flight movement constraints. Specifically, we propose a deep reinforcement learning (DRL)-based trajectory design for completion time minimization (DRL-TDCTM), which is developed from a deep deterministic policy gradient algorithm. In particular, to represent the state information of UAV and environment, we set an additional information, i.e., the merged pheromone, as a reference of reward which facilitates the algorithm design. By interacting with the external environment in the corresponding Markov decision process, the proposed algorithm can continuously and adaptively learn how to adjust the UAV's movement strategy. Finally, simulation results show the superiority of the proposed DRL-TDCTM algorithm over the conventional baseline methods.

READ FULL TEXT

page 1

page 2

research
07/23/2021

Trajectory Design for UAV-Based Internet-of-Things Data Collection: A Deep Reinforcement Learning Approach

In this paper, we investigate an unmanned aerial vehicle (UAV)-assisted ...
research
03/20/2022

Reinforcement learning reward function in unmanned aerial vehicle control tasks

This paper presents a new reward function that can be used for deep rein...
research
09/17/2022

Technical Report for Trend Prediction Based Intelligent UAV Trajectory Planning for Large-scale Dynamic Scenarios

The unmanned aerial vehicle (UAV)-enabled communication technology is re...
research
06/11/2023

UAV Trajectory and Multi-User Beamforming Optimization for Clustered Users Against Passive Eavesdropping Attacks With Unknown CSI

This paper tackles the fundamental passive eavesdropping problem in mode...
research
08/04/2023

Deep Reinforcement Learning Empowered Rate Selection of XP-HARQ

The complex transmission mechanism of cross-packet hybrid automatic repe...
research
03/14/2021

RSS-Based UAV-BS 3-D Mobility Management via Policy Gradient Deep Reinforcement Learning

We address the mobility management of an autonomous UAV-mounted base sta...
research
04/07/2023

UAV Obstacle Avoidance by Human-in-the-Loop Reinforcement in Arbitrary 3D Environment

This paper focuses on the continuous control of the unmanned aerial vehi...

Please sign up or login with your details

Forgot password? Click here to reset