Federated Learning with Local Differential Privacy: Trade-offs between Privacy, Utility, and Communication

02/09/2021
by   Muah Kim, et al.
0

Federated learning (FL) allows to train a massive amount of data privately due to its decentralized structure. Stochastic gradient descent (SGD) is commonly used for FL due to its good empirical performance, but sensitive user information can still be inferred from weight updates shared during FL iterations. We consider Gaussian mechanisms to preserve local differential privacy (LDP) of user data in the FL model with SGD. The trade-offs between user privacy, global utility, and transmission rate are proved by defining appropriate metrics for FL with LDP. Compared to existing results, the query sensitivity used in LDP is defined as a variable and a tighter privacy accounting method is applied. The proposed utility bound allows heterogeneous parameters over all users. Our bounds characterize how much utility decreases and transmission rate increases if a stronger privacy regime is targeted. Furthermore, given a target privacy level, our results guarantee a significantly larger utility and a smaller transmission rate as compared to existing privacy accounting methods.

READ FULL TEXT

page 1

page 2

page 3

page 4

09/08/2020

Toward Robustness and Privacy in Federated Learning: Experimenting with Local and Central Differential Privacy

Federated Learning (FL) allows multiple participants to collaboratively ...
06/01/2021

Wireless Federated Learning with Limited Communication and Differential Privacy

This paper investigates the role of dimensionality reduction in efficien...
10/09/2017

Optimization of Privacy-Utility Trade-offs under Informational Self-determination

The pervasiveness of Internet of Things results in vast volumes of perso...
05/23/2021

Fast Federated Learning by Balancing Communication Trade-Offs

Federated Learning (FL) has recently received a lot of attention for lar...
07/24/2022

BPFISH: Blockchain and Privacy-preserving FL Inspired Smart Healthcare

This paper proposes Federated Learning (FL) based smart healthcare syste...
06/10/2022

Hierarchical Federated Learning with Privacy

Federated learning (FL), where data remains at the federated clients, an...
06/26/2021

Benchmarking Differential Privacy and Federated Learning for BERT Models

Natural Language Processing (NLP) techniques can be applied to help with...