FedML-HE: An Efficient Homomorphic-Encryption-Based Privacy-Preserving Federated Learning System

03/20/2023
by   Weizhao Jin, et al.
2

Federated Learning (FL) enables machine learning model training on distributed edge devices by aggregating local model updates rather than local data. However, privacy concerns arise as the FL server's access to local model updates can potentially reveal sensitive personal information by performing attacks like gradient inversion recovery. To address these concerns, privacy-preserving methods, such as Homomorphic Encryption (HE)-based approaches, have been proposed. Despite HE's post-quantum security advantages, its applications suffer from impractical overheads. In this paper, we present FedML-HE, the first practical system for efficient HE-based secure federated aggregation that provides a user/device-friendly deployment platform. FL-HE utilizes a novel universal overhead optimization scheme, significantly reducing both computation and communication overheads during deployment while providing customizable privacy guarantees. Our optimized system demonstrates considerable overhead reduction, particularly for large models (e.g.,  10x reduction for HE-federated training of ResNet-50 and  40x reduction for BERT), demonstrating the potential for scalable HE-based FL deployment.

READ FULL TEXT

page 5

page 8

page 11

page 12

research
07/19/2022

MUD-PQFed: Towards Malicious User Detection in Privacy-Preserving Quantized Federated Learning

Federated Learning (FL), a distributed machine learning paradigm, has be...
research
04/14/2021

Privacy-preserving Federated Learning based on Multi-key Homomorphic Encryption

With the advance of machine learning and the internet of things (IoT), s...
research
04/04/2022

Towards Privacy-Preserving and Verifiable Federated Matrix Factorization

Recent years have witnessed the rapid growth of federated learning (FL),...
research
06/09/2020

XOR Mixup: Privacy-Preserving Data Augmentation for One-Shot Federated Learning

User-generated data distributions are often imbalanced across devices an...
research
08/21/2022

Fed-FSNet: Mitigating Non-I.I.D. Federated Learning via Fuzzy Synthesizing Network

Federated learning (FL) has emerged as a promising privacy-preserving di...
research
03/03/2020

Adaptive Federated Learning With Gradient Compression in Uplink NOMA

Federated learning (FL) is an emerging machine learning technique that a...
research
04/05/2022

Privacy-Preserving Federated Learning via System Immersion and Random Matrix Encryption

Federated learning (FL) has emerged as a privacy solution for collaborat...

Please sign up or login with your details

Forgot password? Click here to reset