Trajectory Design for UAV-Based Internet-of-Things Data Collection: A Deep Reinforcement Learning Approach

07/23/2021
by   Yang Wang, et al.
0

In this paper, we investigate an unmanned aerial vehicle (UAV)-assisted Internet-of-Things (IoT) system in a sophisticated three-dimensional (3D) environment, where the UAV's trajectory is optimized to efficiently collect data from multiple IoT ground nodes. Unlike existing approaches focusing only on a simplified two-dimensional scenario and the availability of perfect channel state information (CSI), this paper considers a practical 3D urban environment with imperfect CSI, where the UAV's trajectory is designed to minimize data collection completion time subject to practical throughput and flight movement constraints. Specifically, inspired from the state-of-the-art deep reinforcement learning approaches, we leverage the twin-delayed deep deterministic policy gradient (TD3) to design the UAV's trajectory and present a TD3-based trajectory design for completion time minimization (TD3-TDCTM) algorithm. In particular, we set an additional information, i.e., the merged pheromone, to represent the state information of UAV and environment as a reference of reward which facilitates the algorithm design. By taking the service statuses of IoT nodes, the UAV's position, and the merged pheromone as input, the proposed algorithm can continuously and adaptively learn how to adjust the UAV's movement strategy. By interacting with the external environment in the corresponding Markov decision process, the proposed algorithm can achieve a near-optimal navigation strategy. Our simulation results show the superiority of the proposed TD3-TDCTM algorithm over three conventional non-learning based baseline methods.

READ FULL TEXT

page 1

page 4

page 9

page 10

page 12

research
08/02/2021

Three-Dimensional Trajectory Design for Multi-User MISO UAV Communications: A Deep Reinforcement Learning Approach

In this paper, we investigate a multi-user downlink multiple-input singl...
research
06/28/2018

Robust Fuzzy-Learning For Partially Overlapping Channels Allocation In UAV Communication Networks

In this paper, we consider a mesh-structured unmanned aerial vehicle (UA...
research
06/06/2021

3D UAV Trajectory and Data Collection Optimisation via Deep Reinforcement Learning

Unmanned aerial vehicles (UAVs) are now beginning to be deployed for enh...
research
07/01/2020

UAV Path Planning for Wireless Data Harvesting: A Deep Reinforcement Learning Approach

Autonomous deployment of unmanned aerial vehicles (UAVs) supporting next...
research
12/01/2021

Joint Cluster Head Selection and Trajectory Planning in UAV-Aided IoT Networks by Reinforcement Learning with Sequential Model

Employing unmanned aerial vehicles (UAVs) has attracted growing interest...
research
07/06/2022

Incentivizing Proof-of-Stake Blockchain for Secured Data Collection in UAV-Assisted IoT: A Multi-Agent Reinforcement Learning Approach

The Internet of Things (IoT) can be conveniently deployed while empoweri...
research
05/29/2019

3D Multi-Drone-Cell Trajectory Design for Efficient IoT Data Collection

Drone cell (DC) is an emerging technique to offer flexible and cost-effe...

Please sign up or login with your details

Forgot password? Click here to reset