A Hybrid Framework of Reinforcement Learning and Convex Optimization for UAV-Based Autonomous Metaverse Data Collection

05/29/2023
by   Peiyuan Si, et al.
0

Unmanned aerial vehicles (UAVs) are promising for providing communication services due to their advantages in cost and mobility, especially in the context of the emerging Metaverse and Internet of Things (IoT). This paper considers a UAV-assisted Metaverse network, in which UAVs extend the coverage of the base station (BS) to collect the Metaverse data generated at roadside units (RSUs). Specifically, to improve the data collection efficiency, resource allocation and trajectory control are integrated into the system model. The time-dependent nature of the optimization problem makes it non-trivial to be solved by traditional convex optimization methods. Based on the proposed UAV-assisted Metaverse network system model, we design a hybrid framework with reinforcement learning and convex optimization to cooperatively solve the time-sequential optimization problem. Simulation results show that the proposed framework is able to reduce the mission completion time with a given transmission power resource.

READ FULL TEXT

page 1

page 3

page 4

page 6

research
11/17/2022

UAV Assisted Data Collection for Internet of Things: A Survey

Thanks to the advantages of flexible deployment and high mobility, unman...
research
06/06/2021

3D UAV Trajectory and Data Collection Optimisation via Deep Reinforcement Learning

Unmanned aerial vehicles (UAVs) are now beginning to be deployed for enh...
research
03/01/2021

Technical Report for A Joint User Scheduling and Trajectory Planning Data Collection Strategy for the UAV-assisted WSN

Unmanned aerial vehicles (UAVs) are usually dispatched as mobile sinks t...
research
12/08/2019

RAN Slicing in a UAV Network for eMBB Service Provision

This paper is concerned with a problem of radio access network (RAN) sli...
research
07/06/2022

Incentivizing Proof-of-Stake Blockchain for Secured Data Collection in UAV-Assisted IoT: A Multi-Agent Reinforcement Learning Approach

The Internet of Things (IoT) can be conveniently deployed while empoweri...
research
03/15/2023

Muti-Agent Proximal Policy Optimization For Data Freshness in UAV-assisted Networks

Unmanned aerial vehicles (UAVs) are seen as a promising technology to pe...
research
11/12/2020

Fast or Slow: An Autonomous Speed Control Approach for UAV-assisted IoT Data Collection Networks

Unmanned Aerial Vehicles (UAVs) have been emerging as an effective solut...

Please sign up or login with your details

Forgot password? Click here to reset