DeepAI
Log In Sign Up

Secure Weighted Aggregation in Federated Learning

10/17/2020
by   Jiale Guo, et al.
0

Federated learning (FL) schemes enable multiple clients to jointly solve a machine learning problem using their local data to train a local model, then aggregating these models under the coordination of a central server. To achieve such a practical FL system, we need to consider (i) how to deal with the disparity across clients' datasets, and (ii) how to further protect the privacy of clients' locally trained models, which may leak information. The first concern can be addressed using a weighted aggregation scheme where the weights of clients are determined based on their data size and quality. Approaches in previous works result in a good performance but do not provide any privacy guarantee. For the second concern, privacy-preserving aggregation schemes can provide privacy guarantees that can be mathematically analyzed. However, the security issue still exists that both the central server and clients may send fraudulent messages to each other for their own benefits, especially if there is an incentive mechanism where the reward provided by the server is distributed according to clients' weights. To address the issues mentioned above, we propose a secure weighted aggregation scheme. Precisely, relying on the homomorphic encryption (HE) crypto-system, each client's weight is calculated in a privacy-preserving manner. Furthermore, we adopt a zero-knowledge proof (ZKP) based verification scheme to prevent the central server and clients from receiving fraudulent messages from each other. To the best of our knowledge, this work proposes the first aggregation scheme to deal with data disparity and fraudulent messages in the FL system from both privacy and security perspective.

READ FULL TEXT

page 1

page 2

page 3

page 4

05/11/2022

Blockchain-based Secure Client Selection in Federated Learning

Despite the great potential of Federated Learning (FL) in large-scale di...
07/01/2022

Better Methods and Theory for Federated Learning: Compression, Client Selection and Heterogeneity

Federated learning (FL) is an emerging machine learning paradigm involvi...
04/08/2022

Communication-Efficient Cluster Federated Learning in Large-scale Peer-to-Peer Networks

A traditional federated learning (FL) allows clients to collaboratively ...
08/20/2019

Towards Effective Device-Aware Federated Learning

With the wealth of information produced by social networks, smartphones,...
10/06/2022

FedGraph: an Aggregation Method from Graph Perspective

With the increasingly strengthened data privacy act and the difficult da...
09/15/2020

Federated Dynamic GNN with Secure Aggregation

Given video data from multiple personal devices or street cameras, can w...
04/10/2020

Towards Realistic Byzantine-Robust Federated Learning

Federated Learning (FL) is a distributed machine learning paradigm where...