Federated Learning Framework in Fogbus2-based Edge Computing Environments

11/14/2022
by   Wuji Zhu, et al.
0

Federated learning refers to conducting training on multiple distributed devices and collecting model weights from them to derive a shared machine-learning model. This allows the model to get benefit from a rich source of data available from multiple sites. Also, since only model weights are collected from distributed devices, the privacy of those data is protected. It is useful in a situation where collaborative training of machine learning models is necessary while training data are highly sensitive. This study aims at investigating the implementation of lightweight federated learning to be deployed on a diverse range of distributed resources, including resource-constrained edge devices and resourceful cloud servers. As a resource management framework, the FogBus2 framework, which is a containerized distributed resource management framework, is selected as the base framework for the implementation. This research provides an architecture and lightweight implementation of federated learning in the FogBus2. Moreover, a worker selection technique is proposed and implemented. The worker selection algorithm selects an appropriate set of workers to participate in the training to achieve higher training time efficiency. Besides, this research integrates synchronous and asynchronous models of federated learning alongside with heuristic-based worker selection algorithm. It is proven that asynchronous federated learning is more time efficient compared to synchronous federated learning or sequential machine learning training. The performance evaluation shows the efficiency of the federated learning mechanism implemented and integrated with the FogBus2 framework. The worker selection strategy obtains 33.9 accuracy compared to sequential training, while asynchronous further improve synchronous federated learning training time by 63.3

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/05/2023

FLight: A Lightweight Federated Learning Framework in Edge and Fog Computing

The number of Internet of Things (IoT) applications, especially latency-...
research
03/23/2022

Asynchronous Collaborative Learning Across Data Silos

Machine learning algorithms can perform well when trained on large datas...
research
03/09/2023

Cloudless-Training: A Framework to Improve Efficiency of Geo-Distributed ML Training

Geo-distributed ML training can benefit many emerging ML scenarios (e.g....
research
03/12/2023

Asynchronous Decentralized Federated Lifelong Learning for Landmark Localization in Medical Imaging

Federated learning is a recent development in the machine learning area ...
research
10/01/2020

Optimal Task Assignment to Heterogeneous Federated Learning Devices

Federated Learning provides new opportunities for training machine learn...
research
08/25/2020

Accelerating Federated Learning in Heterogeneous Data and Computational Environments

There are situations where data relevant to a machine learning problem a...
research
06/02/2023

Resource-Efficient Federated Hyperdimensional Computing

In conventional federated hyperdimensional computing (HDC), training lar...

Please sign up or login with your details

Forgot password? Click here to reset