A first look into the carbon footprint of federated learning

10/13/2020
by   Xinchi Qiu, et al.
4

Despite impressive results, deep learning-based technologies also raise severe privacy and environmental concerns induced by the training procedure often conducted in data centers. In response, alternatives to centralized training such as Federated Learning (FL) have emerged. Perhaps unexpectedly, FL in particular is starting to be deployed at a global scale by companies that must adhere to new legal demands and policies originating from governments and the civil society for privacy protection. However, the potential environmental impact related to FL remains unclear and unexplored. This paper offers the first-ever systematic study of the carbon footprint of FL. First, we propose a rigorous model to quantify the carbon footprint, hence facilitating the investigation of the relationship between FL design and carbon emissions. Then, we compare the carbon footprint of FL to traditional centralized learning. We also formalize an early-stage FL optimization problem enabling the community to consider the importance of optimizing the rate of CO_2 emissions jointly to the accuracy of neural networks. Finally, we highlight and connect the reported results to the future challenges and trends in FL to reduce its environmental impact, including algorithms efficiency, hardware capabilities, and stronger industry transparency.

READ FULL TEXT

page 1

page 2

page 3

page 4

03/18/2021

A Framework for Energy and Carbon Footprint Analysis of Distributed and Federated Edge Learning

Recent advances in distributed learning raise environmental concerns due...
06/21/2022

An Energy and Carbon Footprint Analysis of Distributed and Federated Learning

Classical and centralized Artificial Intelligence (AI) methods require m...
07/08/2022

StatMix: Data augmentation method that relies on image statistics in federated learning

Availability of large amount of annotated data is one of the pillars of ...
12/01/2020

A Systematic Literature Review on Federated Learning: From A Model Quality Perspective

As an emerging technique, Federated Learning (FL) can jointly train a gl...
11/18/2020

FLaaS: Federated Learning as a Service

Federated Learning (FL) is emerging as a promising technology to build m...
09/12/2021

Critical Learning Periods in Federated Learning

Federated learning (FL) is a popular technique to train machine learning...
04/06/2022

Federated Self-supervised Speech Representations: Are We There Yet?

The ubiquity of microphone-enabled devices has lead to large amounts of ...