Federated Learning over Wireless Networks: Convergence Analysis and Resource Allocation

10/29/2019
by   Canh Dinh, et al.
0

There is an increasing interest in a fast-growing machine learning technique called Federated Learning, in which the model training is distributed over mobile user equipments (UEs), exploiting UEs' local computation and training data. Despite its advantages in data privacy-preserving, Federated Learning (FL) still has challenges in heterogeneity across users' data and UE's characteristics. We first address the heterogeneous data challenge by proposing a FL algorithm that can bypass the independent and identically distributed (i.i.d.) UEs' data assumption for strongly convex and smooth problems. We provide the convergence rate characterizing the trade-off between local computation rounds of UE to update its local model and global communication rounds to update the global model. We then employ the proposed FL algorithm in wireless networks as a resource allocation optimization problem that captures various trade-offs between computation and communication latencies as well as between the Federated Learning time and UE energy consumption. Even though the wireless resource allocation problem of FL is non-convex, we exploit this problem's structure to decompose it into three sub-problems and analyze their closed-form solutions as well as insights to problem design. Finally, we illustrate the theoretical analysis for the new algorithm with Tensorflow experiments and extensive numerical results for the wireless resource allocation sub-problems. The experiment results not only verify the theoretical convergence but also show that our proposed algorithm converges significantly faster than the existing baseline approach.

READ FULL TEXT
research
09/04/2023

Computation and Communication Efficient Federated Learning over Wireless Networks

Federated learning (FL) allows model training from local data by edge de...
research
08/04/2023

Analysis and Optimization of Wireless Federated Learning with Data Heterogeneity

With the rapid proliferation of smart mobile devices, federated learning...
research
11/01/2022

Multi-Resource Allocation for On-Device Distributed Federated Learning Systems

This work poses a distributed multi-resource allocation scheme for minim...
research
03/23/2023

Automated Federated Learning in Mobile Edge Networks – Fast Adaptation and Convergence

Federated Learning (FL) can be used in mobile edge networks to train mac...
research
07/04/2021

FedFog: Network-Aware Optimization of Federated Learning over Wireless Fog-Cloud Systems

Federated learning (FL) is capable of performing large distributed machi...
research
06/02/2022

Resource Allocation for Compression-aided Federated Learning with High Distortion Rate

Recently, a considerable amount of works have been made to tackle the co...
research
05/23/2021

Fast Federated Learning by Balancing Communication Trade-Offs

Federated Learning (FL) has recently received a lot of attention for lar...

Please sign up or login with your details

Forgot password? Click here to reset