Full Scaling Automation for Sustainable Development of Green Data Centers

05/01/2023
by   Shiyu Wang, et al.
0

The rapid rise in cloud computing has resulted in an alarming increase in data centers' carbon emissions, which now accounts for >3 gas emissions, necessitating immediate steps to combat their mounting strain on the global climate. An important focus of this effort is to improve resource utilization in order to save electricity usage. Our proposed Full Scaling Automation (FSA) mechanism is an effective method of dynamically adapting resources to accommodate changing workloads in large-scale cloud computing clusters, enabling the clusters in data centers to maintain their desired CPU utilization target and thus improve energy efficiency. FSA harnesses the power of deep representation learning to accurately predict the future workload of each service and automatically stabilize the corresponding target CPU usage level, unlike the previous autoscaling methods, such as Autopilot or FIRM, that need to adjust computing resources with statistical models and expert knowledge. Our approach achieves significant performance improvement compared to the existing work in real-world datasets. We also deployed FSA on large-scale cloud computing clusters in industrial data centers, and according to the certification of the China Environmental United Certification Center (CEC), a reduction of 947 tons of carbon dioxide, equivalent to a saving of 1538,000 kWh of electricity, was achieved during the Double 11 shopping festival of 2022, marking a critical step for our company's strategic goal towards carbon neutrality by 2030.

READ FULL TEXT

page 3

page 7

page 10

page 11

research
08/31/2020

A Self-adaptive Approach for Managing Applications and Harnessing Renewable Energy for Sustainable Cloud Computing

Rapid adoption of Cloud computing for hosting services and its success i...
research
08/18/2019

Workload-Aware Opportunistic Energy Efficiency in Multi-FPGA Platforms

The continuous growth of big data applications with high computational a...
research
05/31/2022

A Meta Reinforcement Learning Approach for Predictive Autoscaling in the Cloud

Predictive autoscaling (autoscaling with workload forecasting) is an imp...
research
02/08/2021

A Framework for Auditing Data Center Energy Usage and Mitigating Environmental Footprint

As the Data Science field continues to mature, and we collect more data,...
research
06/25/2018

Bené: On Demand Cost-Effective Scaling at the Edge

Edge computing has become increasingly popular across many domains and e...
research
05/10/2020

Optimizing Deep Learning Recommender Systems' Training On CPU Cluster Architectures

During the last two years, the goal of many researchers has been to sque...

Please sign up or login with your details

Forgot password? Click here to reset