Federated Learning over Wireless IoT Networks with Optimized Communication and Resources

10/22/2021
by   Hao Chen, et al.
0

To leverage massive distributed data and computation resources, machine learning in the network edge is considered to be a promising technique especially for large-scale model training. Federated learning (FL), as a paradigm of collaborative learning techniques, has obtained increasing research attention with the benefits of communication efficiency and improved data privacy. Due to the lossy communication channels and limited communication resources (e.g., bandwidth and power), it is of interest to investigate fast responding and accurate FL schemes over wireless systems. Hence, we investigate the problem of jointly optimized communication efficiency and resources for FL over wireless Internet of things (IoT) networks. To reduce complexity, we divide the overall optimization problem into two sub-problems, i.e., the client scheduling problem and the resource allocation problem. To reduce the communication costs for FL in wireless IoT networks, a new client scheduling policy is proposed by reusing stale local model parameters. To maximize successful information exchange over networks, a Lagrange multiplier method is first leveraged by decoupling variables including power variables, bandwidth variables and transmission indicators. Then a linear-search based power and bandwidth allocation method is developed. Given appropriate hyper-parameters, we show that the proposed communication-efficient federated learning (CEFL) framework converges at a strong linear rate. Through extensive experiments, it is revealed that the proposed CEFL framework substantially boosts both the communication efficiency and learning performance of both training loss and test accuracy for FL over wireless IoT networks compared to a basic FL approach with uniform resource allocation.

READ FULL TEXT
research
09/17/2019

A Joint Learning and Communications Framework for Federated Learning over Wireless Networks

In this paper, the problem of training federated learning (FL) algorithm...
research
04/30/2021

Convergence Analysis and System Design for Federated Learning over Wireless Networks

Federated learning (FL) has recently emerged as an important and promisi...
research
06/12/2021

Joint Client Scheduling and Resource Allocation under Channel Uncertainty in Federated Learning

The performance of federated learning (FL) over wireless networks depend...
research
09/18/2023

ROAR-Fed: RIS-Assisted Over-the-Air Adaptive Resource Allocation for Federated Learning

Over-the-air federated learning (OTA-FL) integrates communication and mo...
research
02/03/2020

Federated Learning under Channel Uncertainty: Joint Client Scheduling and Resource Allocation

In this work, we propose a novel joint client scheduling and resource bl...
research
05/23/2022

Federated Distillation based Indoor Localization for IoT Networks

Federated distillation (FD) paradigm has been recently proposed as a pro...
research
01/12/2023

Federated Transfer-Ordered-Personalized Learning for Driver Monitoring Application

Federated learning (FL) shines through in the internet of things (IoT) w...

Please sign up or login with your details

Forgot password? Click here to reset