Cooperative Data Collection with Multiple UAVs for Information Freshness in the Internet of Things

03/02/2023
by   Xijun Wang, et al.
0

Maintaining the freshness of information in the Internet of Things (IoT) is a critical yet challenging problem. In this paper, we study cooperative data collection using multiple Unmanned Aerial Vehicles (UAVs) with the objective of minimizing the total average Age of Information (AoI). We consider various constraints of the UAVs, including kinematic, energy, trajectory, and collision avoidance, in order to optimize the data collection process. Specifically, each UAV, which has limited on-board energy, takes off from its initial location and flies over sensor nodes to collect update packets in cooperation with the other UAVs. The UAVs must land at their final destinations with non-negative residual energy after the specified time duration to ensure they have enough energy to complete their missions. It is crucial to design the trajectories of the UAVs and the transmission scheduling of the sensor nodes to enhance information freshness. We model the multi-UAV data collection problem as a Decentralized Partially Observable Markov Decision Process (Dec-POMDP), as each UAV is unaware of the dynamics of the environment and can only observe a part of the sensors. To address the challenges of this problem, we propose a multi-agent Deep Reinforcement Learning (DRL)-based algorithm with centralized learning and decentralized execution. In addition to the reward shaping, we use action masks to filter out invalid actions and ensure that the constraints are met. Simulation results demonstrate that the proposed algorithms can significantly reduce the total average AoI compared to the baseline algorithms, and the use of the action mask method can improve the convergence speed of the proposed algorithm.

READ FULL TEXT
research
03/01/2020

Deep Reinforcement Learning for Fresh Data Collection in UAV-assisted IoT Networks

Due to the flexibility and low operational cost, dispatching unmanned ae...
research
10/23/2020

Multi-UAV Path Planning for Wireless Data Harvesting with Deep Reinforcement Learning

Harvesting data from distributed Internet of Things (IoT) devices with m...
research
09/13/2022

A Learning-Based Trajectory Planning of Multiple UAVs for AoI Minimization in IoT Networks

Many emerging Internet of Things (IoT) applications rely on information ...
research
07/06/2022

Incentivizing Proof-of-Stake Blockchain for Secured Data Collection in UAV-Assisted IoT: A Multi-Agent Reinforcement Learning Approach

The Internet of Things (IoT) can be conveniently deployed while empoweri...
research
12/01/2021

Joint Cluster Head Selection and Trajectory Planning in UAV-Aided IoT Networks by Reinforcement Learning with Sequential Model

Employing unmanned aerial vehicles (UAVs) has attracted growing interest...
research
01/11/2021

Exploiting a Fleet of UAVs for Monitoring and Data Acquisition of a Distributed Sensor Network

This study proposes an efficient data collection strategy exploiting a t...
research
07/24/2023

Multi-UAV Speed Control with Collision Avoidance and Handover-aware Cell Association: DRL with Action Branching

This paper presents a deep reinforcement learning solution for optimizin...

Please sign up or login with your details

Forgot password? Click here to reset