Efficient Federated Learning over Multiple Access Channel with Differential Privacy Constraints

05/15/2020

∙

In this paper, the problem of federated learning (FL) over a multiple access channel (MAC) is considered. More precisely, we consider the FL setting in which clients are prompted to train a machine learning model by simultaneous communications with a parameter server (PS) with the aim of better utilizing the computational resources available in the network. We also consider the additional constraint in which the communication between the users and the PS is subject to a privacy constraint. To minimize the training loss while also satisfying the privacy rate constraint over the MAC channel, the distributed transmission of digital variants of stochastic gradient descents (D-DSGD) is performed by each client. Additionally, binomial noise is also added at each user to preserve the privacy of the transmission. The optimum levels of quantization in the D-DSGD and the binary noise parameters to achieve efficiency in terms of convergence are investigated, subject to privacy constraint and capacity limit of the MAC channel.

READ FULL TEXT

Efficient Federated Learning over Multiple Access Channel with Differential Privacy Constraints

Communication Efficient Federated Learning over Multiple Access Channels

Wireless Federated Learning with Limited Communication and Differential Privacy

Privacy For Free: Wireless Federated Learning Via Uncoded Transmission With Adaptive Power Control

Over-the-Air Federated Learning with Privacy Protection via Correlated Additive Perturbations

Quantized Federated Learning under Transmission Delay and Outage Constraints

Federated Learning with Local Differential Privacy: Trade-offs between Privacy, Utility, and Communication

Federated Learning for THz Channel Estimation

Efficient Federated Learning over Multiple Access Channel with Differential Privacy Constraints

Related Research

Communication Efficient Federated Learning over Multiple Access Channels

Wireless Federated Learning with Limited Communication and Differential Privacy

Privacy For Free: Wireless Federated Learning Via Uncoded Transmission With Adaptive Power Control

Over-the-Air Federated Learning with Privacy Protection via Correlated Additive Perturbations

Quantized Federated Learning under Transmission Delay and Outage Constraints

Federated Learning with Local Differential Privacy: Trade-offs between Privacy, Utility, and Communication

Federated Learning for THz Channel Estimation