Adaptive Caching via Deep Reinforcement Learning

by   Alireza Sadeghi, et al.

Caching is envisioned to play a critical role in next-generation content delivery infrastructure, cellular networks, and Internet architectures. By smartly storing the most popular contents at the storage-enabled network entities during off-peak demand instances, caching can benefit both network infrastructure as well as end users, during on-peak periods. In this context, distributing the limited storage capacity across network entities calls for decentralized caching schemes. Many practical caching systems involve a parent caching node connected to multiple leaf nodes to serve user file requests. To model the two-way interactive influence between caching decisions at the parent and leaf nodes, a reinforcement learning framework is put forth. To handle the large continuous state space, a scalable deep reinforcement learning approach is pursued. The novel approach relies on a deep Q-network to learn the Q-function, and thus the optimal caching policy, in an online fashion. Reinforcing the parent node with ability to learn-and-adapt to unknown policies of leaf nodes as well as spatio-temporal dynamic evolution of file requests, results in remarkable caching performance, as corroborated through numerical tests.


page 1

page 2

page 3

page 4


Reinforcement Learning for Adaptive Caching with Dynamic Storage Pricing

Small base stations (SBs) of fifth-generation (5G) cellular networks are...

Distributed Network Caching via Dynamic Programming

Next-generation communication networks are envisioned to extensively uti...

Adaptive Edge Content Delivery Networks for Web-Scale File Systems

The InterPlanetary File System (IPFS) is an hyper-media distribution pro...

Cocktail Edge Caching: Ride Dynamic Trends of Content Popularity with Ensemble Learning

Edge caching will play a critical role in facilitating the emerging cont...

Multiagent Reinforcement Learning for Autonomous Routing and Pickup Problem with Adaptation to Variable Demand

We derive a learning framework to generate routing/pickup policies for a...

Reversing The Meaning of Node Connectivity for Content Placement in Networks of Caches

It is a widely accepted heuristic in content caching to place the most p...

Cache Optimization Models and Algorithms

Storage resources and caching techniques permeate almost every area of c...

Please sign up or login with your details

Forgot password? Click here to reset