Deep Reinforcement Learning for Unmanned Aerial Vehicle-Assisted Vehicular Networks

06/12/2019
by   Ming Zhu, et al.
1

Unmanned aerial vehicles (UAVs) are envisioned to complement the 5G communication infrastructure in future smart cities. Hot spots easily appear in road intersections, where effective communication among vehicles is challenging. UAVs may serve as relays with the advantages of low price, easy deployment, line-of-sight links, and flexible mobility. In this paper, we study a UAV-assisted vehicular network where the UAV jointly adjusts its transmission power and bandwidth allocation under 3D flight to maximize the total throughput. First, we formulate a Markov Decision Process (MDP) problem by modeling the mobility of vehicles and the state transitions caused by the UAV's 3D flight. Secondly, we solve the target problem using a deep reinforcement learning method, namely, the deep deterministic policy gradient, and propose three solutions with different control objectives. Thirdly, in a simplified model with small state and action spaces, we verify the optimality of proposed algorithms. Comparing with two baseline schemes, we demonstrate the effectiveness of proposed algorithms in a realistic model.

READ FULL TEXT

page 2

page 3

page 4

page 5

page 6

page 7

page 9

page 10

research
06/12/2019

Deep Reinforcement Learning for Unmanned Aerial Vehicle-Assisted Vehicular Networks in Smart Cities

Unmanned aerial vehicles (UAVs) are envisioned to complement the 5G comm...
research
01/18/2023

Workload-Aware Scheduling using Markov Decision Process for Infrastructure-Assisted Learning-Based Multi-UAV Surveillance Networks

In modern networking research, infrastructure-assisted unmanned autonomo...
research
02/19/2020

Cellular UAV-to-Device Communications: Trajectory Design and Mode Selection by Multi-agent Deep Reinforcement Learning

In the current unmanned aircraft systems (UASs) for sensing services, un...
research
10/12/2021

Quality-Aware Deep Reinforcement Learning for Streaming in Infrastructure-Assisted Connected Vehicles

This paper proposes a deep reinforcement learning-based video streaming ...
research
05/26/2020

Integrating LEO Satellite and UAV Relaying via Reinforcement Learning for Non-Terrestrial Networks

A mega-constellation of low-earth orbit (LEO) satellites has the potenti...
research
09/10/2022

Mixed Criticality Communication within an Unmanned Delivery Rotorcraft

Stand-alone functions additional to a UAV flight-controller, such as saf...
research
08/30/2022

Cost-Efficient Deployment of a Reliable Multi-UAV Unmanned Aerial System

In this work, we study the trade-off between the reliability and the inv...

Please sign up or login with your details

Forgot password? Click here to reset