Federated Learning at the Network Edge: When Not All Nodes are Created Equal

01/06/2021
by   Francesco Malandrino, et al.
0

Under the federated learning paradigm, a set of nodes can cooperatively train a machine learning model with the help of a centralized server. Such a server is also tasked with assigning a weight to the information received from each node, and often also to drop too-slow nodes from the learning process. Both decisions have major impact on the resulting learning performance, and can interfere with each other in counterintuitive ways. In this paper, we focus on edge networking scenarios and investigate existing and novel approaches to such model-weighting and node-dropping decisions. Leveraging a set of real-world experiments, we find that popular, straightforward decision-making approaches may yield poor performance, and that considering the quality of data in addition to its quantity can substantially improve learning.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/21/2019

Decentralized Federated Learning: A Segmented Gossip Approach

The emerging concern about data privacy and security has motivated the p...
research
07/19/2023

Graph Federated Learning Based on the Decentralized Framework

Graph learning has a wide range of applications in many scenarios, which...
research
11/04/2021

Earthquake detection at the edge: IoT crowdsensing network

Earthquake Early Warning state of the art systems rely on a network of s...
research
07/05/2021

Towards Node Liability in Federated Learning: Computational Cost and Network Overhead

Many machine learning (ML) techniques suffer from the drawback that thei...
research
10/14/2021

Leveraging Spatial and Temporal Correlations in Sparsified Mean Estimation

We study the problem of estimating at a central server the mean of a set...
research
03/10/2023

Papaya: Federated Learning, but Fully Decentralized

Federated Learning systems use a centralized server to aggregate model u...
research
12/05/2022

Unexpectedly Useful: Convergence Bounds And Real-World Distributed Learning

Convergence bounds are one of the main tools to obtain information on th...

Please sign up or login with your details

Forgot password? Click here to reset