Sparsified Secure Aggregation for Privacy-Preserving Federated Learning

12/23/2021
by   Irem Ergun, et al.
0

Secure aggregation is a popular protocol in privacy-preserving federated learning, which allows model aggregation without revealing the individual models in the clear. On the other hand, conventional secure aggregation protocols incur a significant communication overhead, which can become a major bottleneck in real-world bandwidth-limited applications. Towards addressing this challenge, in this work we propose a lightweight gradient sparsification framework for secure aggregation, in which the server learns the aggregate of the sparsified local model updates from a large number of users, but without learning the individual parameters. Our theoretical analysis demonstrates that the proposed framework can significantly reduce the communication overhead of secure aggregation while ensuring comparable computational complexity. We further identify a trade-off between privacy and communication efficiency due to sparsification. Our experiments demonstrate that our framework reduces the communication overhead by up to 7.8x, while also speeding up the wall clock training time by 1.13x, when compared to conventional secure aggregation benchmarks.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 1

page 2

page 3

page 4

02/11/2020

Turbo-Aggregate: Breaking the Quadratic Aggregation Barrier in Secure Federated Learning

Federated learning is gaining significant interests as it enables model ...
07/21/2020

Byzantine-Resilient Secure Federated Learning

Secure federated learning is a privacy-preserving framework to improve m...
11/30/2019

Federated Learning with Autotuned Communication-Efficient Secure Aggregation

Federated Learning enables mobile devices to collaboratively learn a sha...
12/31/2019

Robust Aggregation for Federated Learning

We present a robust aggregation approach to make federated learning robu...
03/19/2020

Privacy-preserving Traffic Flow Prediction: A Federated Learning Approach

Existing traffic flow forecasting approaches by deep learning models ach...
06/02/2021

Communication-Efficient Split Learning Based on Analog Communication and Over the Air Aggregation

Split-learning (SL) has recently gained popularity due to its inherent p...
07/28/2021

Secure Bayesian Federated Analytics for Privacy-Preserving Trend Detection

Federated analytics has many applications in edge computing, its use can...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.