Analyse or Transmit: Utilising Correlation at the Edge with Deep Reinforcement Learning

09/29/2021
by   Jernej Hribar, et al.
0

Millions of sensors, cameras, meters, and other edge devices are deployed in networks to collect and analyse data. In many cases, such devices are powered only by Energy Harvesting(EH) and have limited energy available to analyse acquired data. When edge infrastructure is available, a device has a choice: to perform analysis locally or offload the task to other resource-rich devices such as cloudlet servers. However, such a choice carries a price in terms of consumed energy and accuracy. On the one hand, transmitting raw data can result in a higher energy cost in comparison to the required energy to process data locally. On the other hand, performing data analytics on servers can improve the task's accuracy. Additionally, due to the correlation between information sent by multiple devices, accuracy might not be affected if some edge devices decide to neither process nor send data and preserve energy instead. For such a scenario, we propose a Deep Reinforcement Learning (DRL) based solution capable of learning and adapting the policy to the time-varying energy arrival due to EH patterns. We leverage two datasets, one to model energy an EH device can collect and the other to model the correlation between cameras. Furthermore, we compare the proposed solution performance to three baseline policies. Our results show that we can increase accuracy by 15 approaches while preventing outages.

READ FULL TEXT

page 1

page 4

research
01/18/2022

Enabling Deep Reinforcement Learning on Energy Constrained Devices at the Edge of the Network

Deep Reinforcement Learning (DRL) solutions are becoming pervasive at th...
research
11/19/2020

Energy Aware Deep Reinforcement Learning Scheduling for Sensors Correlated in Time and Space

Millions of battery-powered sensors deployed for monitoring purposes in ...
research
05/18/2023

Lyapunov-Driven Deep Reinforcement Learning for Edge Inference Empowered by Reconfigurable Intelligent Surfaces

In this paper, we propose a novel algorithm for energy-efficient, low-la...
research
02/13/2020

Simultaneous Energy Harvesting and Information Transmission in a MIMO Full-Duplex System: A Machine Learning-Based Design

We propose a multiple-input multiple-output (MIMO)-based full-duplex (FD...
research
02/15/2022

Energy-Efficient Parking Analytics System using Deep Reinforcement Learning

Advances in deep vision techniques and ubiquity of smart cameras will dr...
research
04/22/2019

Maximum Lifetime Analytics in IoT Networks

This paper studies the problem of allocating bandwidth and computation r...

Please sign up or login with your details

Forgot password? Click here to reset