Genetic CFL: Optimization of Hyper-Parameters in Clustered Federated Learning

07/15/2021
by   shaashwat agrawal, et al.
0

Federated learning (FL) is a distributed model for deep learning that integrates client-server architecture, edge computing, and real-time intelligence. FL has the capability of revolutionizing machine learning (ML) but lacks in the practicality of implementation due to technological limitations, communication overhead, non-IID (independent and identically distributed) data, and privacy concerns. Training a ML model over heterogeneous non-IID data highly degrades the convergence rate and performance. The existing traditional and clustered FL algorithms exhibit two main limitations, including inefficient client training and static hyper-parameter utilization. To overcome these limitations, we propose a novel hybrid algorithm, namely genetic clustered FL (Genetic CFL), that clusters edge devices based on the training hyper-parameters and genetically modifies the parameters cluster-wise. Then, we introduce an algorithm that drastically increases the individual cluster accuracy by integrating the density-based clustering and genetic hyper-parameter optimization. The results are bench-marked using MNIST handwritten digit dataset and the CIFAR-10 dataset. The proposed genetic CFL shows significant improvements and works well with realistic cases of non-IID and ambiguous data.

READ FULL TEXT

page 1

page 5

research
11/07/2022

Over-The-Air Clustered Wireless Federated Learning

Privacy, security, and bandwidth constraints have led to federated learn...
research
02/16/2022

Single-shot Hyper-parameter Optimization for Federated Learning: A General Algorithm Analysis

We address the relatively unexplored problem of hyper-parameter optimiza...
research
10/20/2022

An Improved Algorithm for Clustered Federated Learning

In this paper, we address the dichotomy between heterogeneous models and...
research
11/08/2022

Clustered Federated Learning based on Nonconvex Pairwise Fusion

This study investigates clustered federated learning (FL), one of the fo...
research
01/27/2022

Clustered Vehicular Federated Learning: Process and Optimization

Federated Learning (FL) is expected to play a prominent role for privacy...
research
01/26/2023

Time-sensitive Learning for Heterogeneous Federated Edge Intelligence

Real-time machine learning has recently attracted significant interest d...
research
04/26/2021

Semi-Decentralized Federated Edge Learning for Fast Convergence on Non-IID Data

Federated edge learning (FEEL) has emerged as an effective alternative t...

Please sign up or login with your details

Forgot password? Click here to reset