On Energy Efficiency and Performance Evaluation of SBC based Clusters: A Hadoop case study

01/31/2019
by   Basit Qureshi, et al.
0

Energy efficiency in a data center is a challenge and has garnered researchers interest. In this paper we address the energy efficiency issue of a small scale data center by utilizing Single Board Computer (SBC) based clusters. A compact design layout is presented to build two clusters using 20 nodes each. Extensive testing was carried out to analyze the performance of these clusters using popular performance benchmarks for task execution time, memory/storage utilization, network throughput and energy consumption. Further, we investigate the cost of operating SBC based clusters by correlating energy utilization for the execution time of various benchmarks using workloads of different sizes. Results show that, although the low-cost benefit of a cluster built with ARM-based SBCs is desirable, these clusters yield low comparable performance and energy efficiency due to limited onboard capabilities. It is possible to tweak Hadoop configuration parameters for an ARM-based SBC cluster to efficiently utilize resources. We present, a discussion on the effectiveness of the SBC-based clusters as a testbed for inexpensive and green cloud computing research.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 4

12/20/2018

Energy-aware virtual machine selection method for cloud data center resource allocation

Saving energy is an important issue for cloud providers to reduce energy...
09/30/2016

Revisiting 802.11 Rate Adaptation from Energy Consumption's Perspective

Rate adaptation in 802.11 WLANs has received a lot of attention from the...
07/09/2020

Performance and energy consumption of HPC workloads on a cluster based on Arm ThunderX2 CPU

In this paper, we analyze the performance and energy consumption of an A...
06/26/2017

On the Energy Efficiency of Rate and Transmission Power Control in 802.11

Rate adaptation and transmission power control in 802.11 WLANs have rece...
07/31/2019

Deploying a Top-100 Supercomputer for Large Parallel Workloads: the Niagara Supercomputer

Niagara is currently the fastest supercomputer accessible to academics i...
04/20/2018

Bayesian Admission Policies for Cloud Computing Clusters

Cloud computing providers must handle customer workloads that wish to sc...
06/24/2016

FPMax: a 106GFLOPS/W at 217GFLOPS/mm2 Single-Precision FPU, and a 43.7GFLOPS/W at 74.6GFLOPS/mm2 Double-Precision FPU, in 28nm UTBB FDSOI

FPMax implements four FPUs optimized for latency or throughput workloads...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.