Trajectory Optimization of Flying Energy Sources using Q-Learning to Recharge Hotspot UAVs

03/27/2020
by   Sayed Amir Hoseini, et al.
0

Despite the increasing popularity of commercial usage of UAVs or drone-delivered services, their dependence on the limited-capacity on-board batteries hinders their flight-time and mission continuity. As such, developing in-situ power transfer solutions for topping-up UAV batteries have the potential to extend their mission duration. In this paper, we study a scenario where UAVs are deployed as base stations (UAV-BS) providing wireless Hotspot services to the ground nodes, while harvesting wireless energy from flying energy sources. These energy sources are specialized UAVs (Charger or transmitter UAVs, tUAVs), equipped with wireless power transmitting devices such as RF antennae. tUAVs have the flexibility to adjust their flight path to maximize energy transfer. With the increasing number of UAV-BSs and environmental complexity, it is necessary to develop an intelligent trajectory selection procedure for tUAVs so as to optimize the energy transfer gain. In this paper, we model the trajectory optimization of tUAVs as a Markov Decision Process (MDP) problem and solve it using Q-Learning algorithm. Simulation results confirm that the Q-Learning based optimized trajectory of the tUAVs outperforms two benchmark strategies, namely random path planning and static hovering of the tUAVs.

READ FULL TEXT

page 2

page 6

research
10/26/2020

Energy and Service-priority aware Trajectory Design for UAV-BSs using Double Q-Learning

Next-generation mobile networks have proposed the integration of Unmanne...
research
03/31/2019

Recharging of Flying Base Stations using Airborne RF Energy Sources

This paper presents a new method for recharging flying base stations, ca...
research
03/27/2019

Optimal deployment of sustainable UAV networks for providing wireless coverage

Each UAV is constrained in its energy storage and wireless coverage, and...
research
06/01/2021

Energy-aware placement optimization of UAV base stations via decentralized multi-agent Q-learning

Unmanned aerial vehicles serving as aerial base stations (UAV-BSs) can b...
research
03/02/2018

Throughput Maximization for Laser-Powered UAV Wireless Communication Systems

Laser power has become a viable solution to provide convenient and susta...
research
11/17/2021

Trajectory Prediction Path Planning for an Object Intercepting UAV with a Mounted Depth Camera

A novel control software architecture using ROS C++ is introduced fo...
research
05/14/2019

Multiservice UAVs for Emergency Tasks in Post-disaster Scenarios

UAVs are increasingly being employed to carry out surveillance, parcel d...

Please sign up or login with your details

Forgot password? Click here to reset