Vertical Federated Learning over Cloud-RAN: Convergence Analysis and System Optimization

05/04/2023
by   Yuanming Shi, et al.
0

Vertical federated learning (FL) is a collaborative machine learning framework that enables devices to learn a global model from the feature-partition datasets without sharing local raw data. However, as the number of the local intermediate outputs is proportional to the training samples, it is critical to develop communication-efficient techniques for wireless vertical FL to support high-dimensional model aggregation with full device participation. In this paper, we propose a novel cloud radio access network (Cloud-RAN) based vertical FL system to enable fast and accurate model aggregation by leveraging over-the-air computation (AirComp) and alleviating communication straggler issue with cooperative model aggregation among geographically distributed edge servers. However, the model aggregation error caused by AirComp and quantization errors caused by the limited fronthaul capacity degrade the learning performance for vertical FL. To address these issues, we characterize the convergence behavior of the vertical FL algorithm considering both uplink and downlink transmissions. To improve the learning performance, we establish a system optimization framework by joint transceiver and fronthaul quantization design, for which successive convex approximation and alternate convex search based system optimization algorithms are developed. We conduct extensive simulations to demonstrate the effectiveness of the proposed system architecture and optimization framework for vertical FL.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/21/2021

Hierarchical Over-the-Air Federated Edge Learning

Federated learning (FL) over wireless communication channels, specifical...
research
05/25/2022

Scalable and Low-Latency Federated Learning with Cooperative Mobile Edge Networking

Federated learning (FL) enables collaborative model training without cen...
research
01/13/2023

STAR-RIS Assisted Over-the-Air Vertical Federated Learning in Multi-Cell Wireless Networks

Vertical federated learning (FL) is a critical enabler for distributed a...
research
05/17/2023

Over-the-Air Federated Learning in MIMO Cloud-RAN Systems

To address the limitations of traditional over-the-air federated learnin...
research
01/21/2022

Vertical Federated Edge Learning with Distributed Integrated Sensing and Communication

This letter studies a vertical federated edge learning (FEEL) system for...
research
07/04/2021

FedFog: Network-Aware Optimization of Federated Learning over Wireless Fog-Cloud Systems

Federated learning (FL) is capable of performing large distributed machi...
research
12/02/2021

How global observation works in Federated Learning: Integrating vertical training into Horizontal Federated Learning

Federated learning (FL) has recently emerged as a transformative paradig...

Please sign up or login with your details

Forgot password? Click here to reset