Asynchronous Federated Learning for Sensor Data with Concept Drift

09/01/2021
by   Yujing Chen, et al.
9

Federated learning (FL) involves multiple distributed devices jointly training a shared model without any of the participants having to reveal their local data to a centralized server. Most of previous FL approaches assume that data on devices are fixed and stationary during the training process. However, this assumption is unrealistic because these devices usually have varying sampling rates and different system configurations. In addition, the underlying distribution of the device data can change dynamically over time, which is known as concept drift. Concept drift makes the learning process complicated because of the inconsistency between existing and upcoming data. Traditional concept drift handling techniques such as chunk based and ensemble learning-based methods are not suitable in the federated learning frameworks due to the heterogeneity of local devices. We propose a novel approach, FedConD, to detect and deal with the concept drift on local devices and minimize the effect on the performance of models in asynchronous FL. The drift detection strategy is based on an adaptive mechanism which uses the historical performance of the local models. The drift adaptation is realized by adjusting the regularization parameter of objective function on each local device. Additionally, we design a communication strategy on the server side to select local updates in a prudent fashion and speed up model convergence. Experimental evaluations on three evolving data streams and two image datasets show that  detects and handles concept drift, and also reduces the overall communication cost compared to other baseline methods.

READ FULL TEXT
research
11/05/2019

Asynchronous Online Federated Learning for Edge Devices

Federated learning (FL) is a machine learning paradigm where a shared ce...
research
11/22/2022

Online Federated Learning via Non-Stationary Detection and Adaptation amidst Concept Drift

Federated Learning (FL) is an emerging domain in the broader context of ...
research
05/15/2023

FLARE: Detection and Mitigation of Concept Drift for Federated Learning based IoT Deployments

Intelligent, large-scale IoT ecosystems have become possible due to rece...
research
06/01/2022

Federated Learning under Distributed Concept Drift

Federated Learning (FL) under distributed concept drift is a largely une...
research
10/28/2022

Efficient and Light-Weight Federated Learning via Asynchronous Distributed Dropout

Asynchronous learning protocols have regained attention lately, especial...
research
12/13/2022

Robust Split Federated Learning for U-shaped Medical Image Networks

U-shaped networks are widely used in various medical image tasks, such a...
research
01/09/2023

Revisiting Cellular Throughput Prediction: Learning in-situ for Multi-device and Multi-network Considerations for 5G

Recent advancement in the ultra-highspeed cellular networks has pivoted ...

Please sign up or login with your details

Forgot password? Click here to reset