Divide and Save: Splitting Workload Among Containers in an Edge Device to Save Energy and Time

02/13/2023
by   Aria Khoshsirat, et al.
0

The increasing demand for edge computing is leading to a rise in energy consumption from edge devices, which can have significant environmental and financial implications. To address this, in this paper we present a novel method to enhance the energy efficiency while speeding up computations by distributing the workload among multiple containers in an edge device. Experiments are conducted on two Nvidia Jetson edge boards, the TX2 and the AGX Orin, exploring how using a different number of containers can affect the energy consumption and the computational time for an inference task. To demonstrate the effectiveness of our splitting approach, a video object detection task is conducted using an embedded version of the state-of-the-art YOLO algorithm, quantifying the energy and the time savings achieved compared to doing the computations on a single container. The proposed method can help mitigate the environmental and economic consequences of high energy consumption in edge computing, by providing a more sustainable approach to managing the workload of edge devices.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/15/2022

The Effects of Partitioning Strategies on Energy Consumption in Distributed CNN Inference at The Edge

Nowadays, many AI applications utilizing resource-constrained edge devic...
research
11/16/2021

The Case for Approximate Intermittent Computing

We present the concept of approximate intermittent computing and demonst...
research
04/02/2021

A Comprehensive and Accurate Energy Model for Arm's Cortex-M0 Processor

Energy modeling can enable energy-aware software development and assist ...
research
02/24/2019

Image Classification on IoT Edge Devices: Profiling and Modeling

With the advent of powerful, low-cost IoT systems, processing data close...
research
05/06/2020

AVAC: A Machine Learning based Adaptive RRAM Variability-Aware Controller for Edge Devices

Recently, the Edge Computing paradigm has gained significant popularity ...
research
04/17/2018

Are FPGAs Suitable for Edge Computing?

The rapid growth of Internet-of-things (IoT) and artificial intelligence...
research
06/15/2022

Mandheling: Mixed-Precision On-Device DNN Training with DSP Offloading

This paper proposes Mandheling, the first system that enables highly res...

Please sign up or login with your details

Forgot password? Click here to reset