DeepAI AI Chat
Log In Sign Up

Liquid State Machine Learning for Resource and Cache Management in LTE-U Unmanned Aerial Vehicle (UAV) Networks

01/29/2018
by   Mingzhe Chen, et al.
0

In this paper, the problem of joint caching and resource allocation is investigated for a network of cache-enabled unmanned aerial vehicles (UAVs) that service wireless ground users over the LTE licensed and unlicensed (LTE-U) bands. The considered model focuses on users that can access both licensed and unlicensed bands while receiving contents from either the cache units at the UAVs directly or via content server-UAV-user links. This problem is formulated as an optimization problem which jointly incorporates user association, spectrum allocation, and content caching. To solve this problem, a distributed algorithm based on the machine learning framework of liquid state machine (LSM) is proposed. Using the proposed LSM algorithm, the cloud can predict the users' content request distribution while having only limited information on the network's and users' states. The proposed algorithm also enables the UAVs to autonomously choose the optimal resource allocation strategies that maximize the number of users with stable queues depending on the network states. Based on the users' association and content request distributions, the optimal contents that need to be cached at UAVs as well as the optimal resource allocation are derived. Simulation results using real datasets show that the proposed approach yields up to 33.3 the number of users that have stable queues compared to two baseline algorithms: Q-learning with cache and Q-learning without cache. The results also show that LSM significantly improves the convergence time of up to 33.3 compared to conventional learning algorithms such as Q-learning.

READ FULL TEXT

page 1

page 5

page 11

08/19/2020

DDPG-based Resource Management for MEC/UAV-Assisted Vehicular Networks

In this paper, we investigate joint vehicle association and multi-dimens...
02/18/2019

Optimized Trajectory Design in UAV Based Cellular Networks for 3D Users: A Double Q-Learning Approach

In this paper, the problem of trajectory design of unmanned aerial vehic...
08/12/2020

Caching Placement and Resource Allocation for Cache-Enabling UAV NOMA Networks

This article investigates the cache-enabling unmanned aerial vehicle (UA...
10/15/2018

Learn to Fly: A Distributed Mechanism for Joint 3D Placement and Users Association in UAVs-assisted Networks

In this paper, we study the joint 3D placement of unmanned aerial vehicl...
01/28/2021

Joint Transmission Scheme and Coded Content Placement in Cluster-centric UAV-aided Cellular Networks

Recently, as a consequence of the COVID-19 pandemic, dependence on telec...