Optimized Trajectory Design in UAV Based Cellular Networks for 3D Users: A Double Q-Learning Approach

02/18/2019
by   Xuanlin Liu, et al.
0

In this paper, the problem of trajectory design of unmanned aerial vehicles (UAVs) for maximizing the number of satisfied users is studied in a UAV based cellular network where the UAV works as a flying base station that serves users, and the user indicates its satisfaction in terms of completion of its data request within an allowable maximum waiting time. The trajectory design is formulated as an optimization problem whose goal is to maximize the number of satisfied users. To solve this problem, a machine learning framework based on double Q-learning algorithm is proposed. The algorithm enables the UAV to find the optimal trajectory that maximizes the number of satisfied users. Compared to the traditional learning algorithms, such as Q-learning that selects and evaluates the action using the same Q-table, the proposed algorithm can decouple the selection from the evaluation, therefore avoid overestimation which leads to sub-optimal policies. Simulation results show that the proposed algorithm can achieve up to 19.4 satisfied users compared to random algorithm and Q-learning algorithm.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/15/2020

Sense-Store-Send: Trajectory Optimization for a Buffer-aided Internet of UAVs

In this letter, we study a buffer-aided Internet of unmanned aerial vehi...
research
01/29/2018

Liquid State Machine Learning for Resource and Cache Management in LTE-U Unmanned Aerial Vehicle (UAV) Networks

In this paper, the problem of joint caching and resource allocation is i...
research
02/09/2020

UAV Trajectory Optimization for Time Constrained Applications

Unmanned Aerial Vehicles (UAVs) are poised to revolutionize communicatio...
research
06/23/2019

Reinforcement Learning-Based Trajectory Design for the Aerial Base Stations

In this paper, the trajectory optimization problem for a multi-aerial ba...
research
06/23/2019

Reinforcement Learning-Based Trajectory Design for the Drone Base Stations

In this paper, the trajectory optimization problem for a multi-unmanned ...
research
02/24/2020

A Double Q-Learning Approach for Navigation of Aerial Vehicles with Connectivity Constraint

This paper studies the trajectory optimization problem for an aerial veh...
research
02/04/2021

Optimal Trajectories of a UAV Base Station Using Hamilton-Jacobi Equations

We consider the problem of optimizing the trajectory of an Unmanned Aeri...

Please sign up or login with your details

Forgot password? Click here to reset