Energy-Efficient AI over a Virtualized Cloud Fog Network

by   Barzan A. Yosuf, et al.

Deep Neural Networks (DNNs) have served as a catalyst in introducing a plethora of next-generation services in the era of Internet of Things (IoT), thanks to the availability of massive amounts of data collected by the objects on the edge. Currently, DNN models are used to deliver many Artificial Intelligence (AI) services that include image and natural language processing, speech recognition, and robotics. Accordingly, such services utilize various DNN models that make it computationally intensive for deployment on the edge devices alone. Thus, most AI models are offloaded to distant cloud data centers (CDCs), which tend to consolidate large amounts of computing and storage resources into one or more CDCs. Deploying services in the CDC will inevitably lead to excessive latencies and overall increase in power consumption. Instead, fog computing allows for cloud services to be extended to the edge of the network, which allows for data processing to be performed closer to the end-user device. However, different from cloud data centers, fog nodes have limited computational power and are highly distributed in the network. In this paper, using Mixed Integer Linear Programming (MILP), we formulate the placement of DNN inference models, which is abstracted as a network embedding problem in a Cloud Fog Network (CFN) architecture, where power savings are introduced through trade-offs between processing and networking. We study the performance of the CFN architecture by comparing the energy savings when compared to the baseline approach which is the CDC.


Energy-Efficient Distributed Machine Learning in Cloud Fog Networks

Massive amounts of data are expected to be generated by the billions of ...

Energy Efficient VM Placement in a Heterogeneous Fog Computing Architecture

Recent years have witnessed a remarkable development in communication an...

Energy Efficient Distributed Processing for IoT

In this paper, the entire IoT-fog-cloud architecture is modelled, the se...

Towards Energy Consumption and Carbon Footprint Testing for AI-driven IoT Services

Energy consumption and carbon emissions are expected to be crucial facto...

Cloud Fog Architectures in 6G Networks

Prior to the advent of the cloud, storage and processing services were a...

Energy Efficient Neural Network Embedding in IoT over Passive Optical Networks

In the near future, IoT based application services are anticipated to co...

Application Component Placement in NFV-based Hybrid Cloud/Fog Systems

Applications are sets of interacting components that can be executed in ...

Please sign up or login with your details

Forgot password? Click here to reset