Asynchronous Online Federated Learning for Edge Devices

11/05/2019
by   Yujing Chen, et al.
0

Federated learning (FL) is a machine learning paradigm where a shared central model is learned across multiple distributed client devices while the training data remains on edge devices or local clients. Most prior work on federated learning uses Federated Averaging (FedAvg) as an optimization method for training in a synchronized fashion. This involves independent training at multiple edge devices with synchronous aggregation steps. However, the assumptions made by FedAvg are not realistic given the heterogeneity of devices. In particular, the volume and distribution of collected data vary in the training process due to different sampling rates of edge devices. The edge devices themselves also vary in their available communication bandwidth and system configurations, such as memory, processor speed, and power requirements. This leads to vastly different training times as well as model/data transfer times. Furthermore, availability issues at edge devices can lead to a lack of contribution from specific edge devices to the federated model. In this paper, we present an Asynchronous Online Federated Learning (ASO- fed) framework, where the edge devices perform online learning with continuous streaming local data and a central server aggregates model parameters from local clients. Our framework updates the central model in an asynchronous manner to tackle the challenges associated with both varying computational loads at heterogeneous edge devices and edge devices that lag behind or dropout. Experiments on three real-world datasets show the effectiveness of ASO-fed on lowering the overall training cost and maintaining good prediction performance.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/07/2022

FedGrad: Optimisation in Decentralised Machine Learning

Federated Learning is a machine learning paradigm where we aim to train ...
research
09/01/2021

Asynchronous Federated Learning for Sensor Data with Concept Drift

Federated learning (FL) involves multiple distributed devices jointly tr...
research
07/25/2023

EdgeConvEns: Convolutional Ensemble Learning for Edge Intelligence

Deep edge intelligence aims to deploy deep learning models that demand c...
research
01/21/2023

ScaDLES: Scalable Deep Learning over Streaming data at the Edge

Distributed deep learning (DDL) training systems are designed for cloud ...
research
07/18/2021

Federated Action Recognition on Heterogeneous Embedded Devices

Federated learning allows a large number of devices to jointly learn a m...
research
03/27/2023

Asynchronous Online Federated Learning with Reduced Communication Requirements

Online federated learning (FL) enables geographically distributed device...
research
11/01/2021

FedFm: Towards a Robust Federated Learning Approach For Fault Mitigation at the Edge Nodes

Federated Learning deviates from the norm of "send data to model" to "se...

Please sign up or login with your details

Forgot password? Click here to reset