How Much Does It Cost to Train a Machine Learning Model over Distributed Data Sources?

09/15/2022
by   Elia Guerra, et al.
0

Federated learning (FL) is one of the most appealing alternatives to the standard centralized learning paradigm, allowing heterogeneous set of devices to train a machine learning model without sharing their raw data. However, FL requires a central server to coordinate the learning process, thus introducing potential scalability and security issues. In the literature, server-less FL approaches like gossip federated learning (GFL) and blockchain-enabled federated learning (BFL) have been proposed to mitigate these issues. In this work, we propose a complete overview of these three techniques proposing a comparison according to an integral set of performance indicators, including model accuracy, time complexity, communication overhead, convergence time and energy consumption. An extensive simulation campaign permits to draw a quantitative analysis. In particular, GFL is able to save the 18 time, the 68 CFL solution, but it is not able to reach the level of accuracy of CFL. On the other hand, BFL represents a viable solution for implementing decentralized learning with a higher level of security, at the cost of an extra energy usage and data sharing. Finally, we identify open issues on the two decentralized federated learning implementations and provide insights on potential extensions and possible research directions on this new research field.

READ FULL TEXT

page 1

page 14

research
04/13/2023

Decentralized federated learning methods for reducing communication cost and energy consumption in UAV networks

Unmanned aerial vehicles (UAV) or drones play many roles in a modern sma...
research
11/07/2022

Over-The-Air Clustered Wireless Federated Learning

Privacy, security, and bandwidth constraints have led to federated learn...
research
12/10/2019

Advances and Open Problems in Federated Learning

Federated learning (FL) is a machine learning setting where many clients...
research
09/14/2020

A Principled Approach to Data Valuation for Federated Learning

Federated learning (FL) is a popular technique to train machine learning...
research
11/15/2022

Decentralized Federated Learning: Fundamentals, State-of-the-art, Frameworks, Trends, and Challenges

In the last decade, Federated Learning (FL) has gained relevance in trai...
research
11/13/2021

An Energy Consumption Model for Electrical Vehicle Networks via Extended Federated-learning

Electrical vehicle (EV) raises to promote an eco-sustainable society. Ne...
research
04/06/2022

DeFTA: A Plug-and-Play Decentralized Replacement for FedAvg

Federated learning (FL) is identified as a crucial enabler for large-sca...

Please sign up or login with your details

Forgot password? Click here to reset