Federated Learning for Data Streams

01/04/2023
by   Othmane Marfoq, et al.
0

Federated learning (FL) is an effective solution to train machine learning models on the increasing amount of data generated by IoT devices and smartphones while keeping such data localized. Most previous work on federated learning assumes that clients operate on static datasets collected before training starts. This approach may be inefficient because 1) it ignores new samples clients collect during training, and 2) it may require a potentially long preparatory phase for clients to collect enough data. Moreover, learning on static datasets may be simply impossible in scenarios with small aggregate storage across devices. It is, therefore, necessary to design federated algorithms able to learn from data streams. In this work, we formulate and study the problem of federated learning for data streams. We propose a general FL algorithm to learn from data streams through an opportune weighted empirical risk minimization. Our theoretical analysis provides insights to configure such an algorithm, and we evaluate its performance on a wide range of machine learning tasks.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/07/2022

FedGrad: Optimisation in Decentralised Machine Learning

Federated Learning is a machine learning paradigm where we aim to train ...
research
07/12/2023

Tackling Computational Heterogeneity in FL: A Few Theoretical Insights

The future of machine learning lies in moving data collection along with...
research
03/26/2021

Prior-Independent Auctions for the Demand Side of Federated Learning

Federated learning (FL) is a paradigm that allows distributed clients to...
research
03/15/2023

Comparative Evaluation of Data Decoupling Techniques for Federated Machine Learning with Database as a Service

Federated Learning (FL) is a machine learning approach that allows multi...
research
01/11/2023

Federated Learning under Heterogeneous and Correlated Client Availability

The enormous amount of data produced by mobile and IoT devices has motiv...
research
02/20/2023

Federated Gradient Matching Pursuit

Traditional machine learning techniques require centralizing all trainin...
research
10/01/2020

Optimal Task Assignment to Heterogeneous Federated Learning Devices

Federated Learning provides new opportunities for training machine learn...

Please sign up or login with your details

Forgot password? Click here to reset