Path Design for Cellular-Connected UAV with Reinforcement Learning

05/09/2019
by   Yong Zeng, et al.
0

This paper studies the path design problem for cellular-connected unmanned aerial vehicle (UAV), which aims to minimize its mission completion time while maintaining good connectivity with the cellular network. We first argue that the conventional path design approach via formulating and solving optimization problems faces several practical challenges, and then propose a new reinforcement learning-based UAV path design algorithm by applying temporal-difference method to directly learn the state-value function of the corresponding Markov Decision Process. The proposed algorithm is further extended by using linear function approximation with tile coding to deal with large state space. The proposed algorithms only require the raw measured or simulation-generated signal strength as the input and are suitable for both online and offline implementations. Numerical results show that the proposed path designs can successfully avoid the coverage holes of cellular networks even in the complex urban environment.

READ FULL TEXT

page 1

page 5

page 6

research
09/21/2020

Mobile Cellular-Connected UAVs: Reinforcement Learning for Sky Limits

A cellular-connected unmanned aerial vehicle (UAV)faces several key chal...
research
03/17/2020

Simultaneous Navigation and Radio Mapping for Cellular-Connected UAV with Deep Reinforcement Learning

Cellular-connected unmanned aerial vehicle (UAV) is a promising technolo...
research
11/07/2022

A Transfer Learning Approach for UAV Path Design with Connectivity Outage Constraint

The connectivity-aware path design is crucial in the effective deploymen...
research
11/04/2019

3D-Map Assisted UAV Trajectory Design Under Cellular Connectivity Constraints

The enabling of safe cellular controlled unmanned aerial vehicle (UAV) b...
research
05/13/2019

Radio Map Based Path Planning for Cellular-Connected UAV

In this paper, we study the path planning for a cellular-connected unman...
research
01/27/2020

Cellular Decomposition for Non-repetitive Coverage Task with Minimum Discontinuities

A mechanism to derive non-repetitive coverage path solutions with a prov...

Please sign up or login with your details

Forgot password? Click here to reset