Comparative assessment of federated and centralized machine learning

02/03/2022
by   Ibrahim Abdul Majeed, et al.
0

Federated Learning (FL) is a privacy preserving machine learning scheme, where training happens with data federated across devices and not leaving them to sustain user privacy. This is ensured by making the untrained or partially trained models to reach directly the individual devices and getting locally trained "on-device" using the device owned data, and the server aggregating all the partially trained model learnings to update a global model. Although almost all the model learning schemes in the federated learning setup use gradient descent, there are certain characteristic differences brought about by the non-IID nature of the data availability, that affects the training in comparison to the centralized schemes. In this paper, we discuss the various factors that affect the federated learning training, because of the non-IID distributed nature of the data, as well as the inherent differences in the federating learning approach as against the typical centralized gradient descent techniques. We empirically demonstrate the effect of number of samples per device and the distribution of output labels on federated learning. In addition to the privacy advantage we seek through federated learning, we also study if there is a cost advantage while using federated learning frameworks. We show that federated learning does have an advantage in cost when the model sizes to be trained are not reasonably large. All in all, we present the need for careful design of model for both performance and cost.

READ FULL TEXT

page 8

page 11

page 12

research
06/12/2021

Federated Learning on Non-IID Data: A Survey

Federated learning is an emerging distributed machine learning framework...
research
04/05/2021

FedPandemic: A Cross-Device Federated Learning Approach Towards Elementary Prognosis of Diseases During a Pandemic

The amount of data, manpower and capital required to understand, evaluat...
research
10/05/2020

Federated learning using a mixture of experts

Federated learning has received attention for its efficiency and privacy...
research
06/02/2022

Applied Federated Learning: Architectural Design for Robust and Efficient Learning in Privacy Aware Settings

The classical machine learning paradigm requires the aggregation of user...
research
05/31/2023

FedCSD: A Federated Learning Based Approach for Code-Smell Detection

This paper proposes a Federated Learning Code Smell Detection (FedCSD) a...
research
10/29/2020

Training Speech Recognition Models with Federated Learning: A Quality/Cost Framework

We propose using federated learning, a decentralized on-device learning ...
research
04/11/2022

Production federated keyword spotting via distillation, filtering, and joint federated-centralized training

We trained a keyword spotting model using federated learning on real use...

Please sign up or login with your details

Forgot password? Click here to reset