DeepAI
Log In Sign Up

Energy-Efficient AI over a Virtualized Cloud Fog Network

05/07/2021
by   Barzan A. Yosuf, et al.
0

Deep Neural Networks (DNNs) have served as a catalyst in introducing a plethora of next-generation services in the era of Internet of Things (IoT), thanks to the availability of massive amounts of data collected by the objects on the edge. Currently, DNN models are used to deliver many Artificial Intelligence (AI) services that include image and natural language processing, speech recognition, and robotics. Accordingly, such services utilize various DNN models that make it computationally intensive for deployment on the edge devices alone. Thus, most AI models are offloaded to distant cloud data centers (CDCs), which tend to consolidate large amounts of computing and storage resources into one or more CDCs. Deploying services in the CDC will inevitably lead to excessive latencies and overall increase in power consumption. Instead, fog computing allows for cloud services to be extended to the edge of the network, which allows for data processing to be performed closer to the end-user device. However, different from cloud data centers, fog nodes have limited computational power and are highly distributed in the network. In this paper, using Mixed Integer Linear Programming (MILP), we formulate the placement of DNN inference models, which is abstracted as a network embedding problem in a Cloud Fog Network (CFN) architecture, where power savings are introduced through trade-offs between processing and networking. We study the performance of the CFN architecture by comparing the energy savings when compared to the baseline approach which is the CDC.

READ FULL TEXT
05/20/2021

Energy-Efficient Distributed Machine Learning in Cloud Fog Networks

Massive amounts of data are expected to be generated by the billions of ...
03/27/2022

Energy Efficient VM Placement in a Heterogeneous Fog Computing Architecture

Recent years have witnessed a remarkable development in communication an...
01/09/2020

Energy Efficient Distributed Processing for IoT

In this paper, the entire IoT-fog-cloud architecture is modelled, the se...
08/10/2020

Cloud Fog Architectures in 6G Networks

Prior to the advent of the cloud, storage and processing services were a...
04/11/2020

Optimized Distributed Processing in a Vehicular Cloud Architecture

The introduction of cloud data centres has opened new possibilities for ...
05/02/2020

Energy Efficient Neural Network Embedding in IoT over Passive Optical Networks

In the near future, IoT based application services are anticipated to co...
10/16/2019

Using Cloud and Fog Computing for Large Scale IoT-based Urban Sound Classification

The Internet of Things (IoT) has become the forefront of bridging differ...