Efficient Federated Meta-Learning over Multi-Access Wireless Networks

08/14/2021
by   Sheng Yue, et al.
0

Federated meta-learning (FML) has emerged as a promising paradigm to cope with the data limitation and heterogeneity challenges in today's edge learning arena. However, its performance is often limited by slow convergence and corresponding low communication efficiency. In addition, since the available radio spectrum and IoT devices' energy capacity are usually insufficient, it is crucial to control the resource allocation and energy consumption when deploying FML in practical wireless networks. To overcome the challenges, in this paper, we rigorously analyze each device's contribution to the global loss reduction in each round and develop an FML algorithm (called NUFM) with a non-uniform device selection scheme to accelerate the convergence. After that, we formulate a resource allocation problem integrating NUFM in multi-access wireless systems to jointly improve the convergence rate and minimize the wall-clock time along with energy cost. By deconstructing the original problem step by step, we devise a joint device selection and resource allocation strategy to solve the problem with theoretical guarantees. Further, we show that the computational complexity of NUFM can be reduced from O(d^2) to O(d) (with the model dimension d) via combining two first-order approximation techniques. Extensive simulation results demonstrate the effectiveness and superiority of the proposed methods in comparison with existing baselines.

READ FULL TEXT
research
09/14/2022

Age of Information in Federated Learning over Wireless Networks

In this paper, federated learning (FL) over wireless networks is investi...
research
09/04/2023

Computation and Communication Efficient Federated Learning over Wireless Networks

Federated learning (FL) allows model training from local data by edge de...
research
05/25/2019

Fair Resource Allocation in Federated Learning

Federated learning involves training statistical models in massive, hete...
research
09/17/2023

User Assignment and Resource Allocation for Hierarchical Federated Learning over Wireless Networks

The large population of wireless users is a key driver of data-crowdsour...
research
05/03/2023

Optimal Resource Management for Hierarchical Federated Learning over HetNets with Wireless Energy Transfer

Remote monitoring systems analyze the environment dynamics in different ...
research
04/18/2022

Split Learning over Wireless Networks: Parallel Design and Resource Management

Split learning (SL) is a collaborative learning framework, which can tra...
research
06/13/2022

Toward Ambient Intelligence: Federated Edge Learning with Task-Oriented Sensing, Computation, and Communication Integration

In this paper, we address the problem of joint sensing, computation, and...

Please sign up or login with your details

Forgot password? Click here to reset