Log In Sign Up

Accurate and Fast Federated Learning via Combinatorial Multi-Armed Bandits

by   Taehyeon Kim, et al.

Federated learning has emerged as an innovative paradigm of collaborative machine learning. Unlike conventional machine learning, a global model is collaboratively learned while data remains distributed over a tremendous number of client devices, thus not compromising user privacy. However, several challenges still remain despite its glowing popularity; above all, the global aggregation in federated learning involves the challenge of biased model averaging and lack of prior knowledge in client sampling, which, in turn, leads to high generalization error and slow convergence rate, respectively. In this work, we propose a novel algorithm called FedCM that addresses the two challenges by utilizing prior knowledge with multi-armed bandit based client sampling and filtering biased models with combinatorial model averaging. Based on extensive evaluations using various algorithms and representative heterogeneous datasets, we showed that FedCM significantly outperformed the state-of-the-art algorithms by up to 37.25 terms of generalization accuracy and convergence rate.


page 4

page 9


Faster On-Device Training Using New Federated Momentum Algorithm

Mobile crowdsensing has gained significant attention in recent years and...

Accurate and Fast Federated Learning via IID and Communication-Aware Grouping

Federated learning has emerged as a new paradigm of collaborative machin...

Federated X-Armed Bandit

This work establishes the first framework of federated 𝒳-armed bandit, w...

Federated Multi-Armed Bandits

Federated multi-armed bandits (FMAB) is a new bandit paradigm that paral...

Distributed Optimization over Block-Cyclic Data

We consider practical data characteristics underlying federated learning...

TornadoAggregate: Accurate and Scalable Federated Learning via the Ring-Based Architecture

Federated learning has emerged as a new paradigm of collaborative machin...

Linear Jamming Bandits: Sample-Efficient Learning for Non-Coherent Digital Jamming

It has been shown (Amuru et al. 2015) that online learning algorithms ca...