Secure and Efficient Decentralized Federated Learning with Data Representation Protection

05/21/2022
by   Zhen Qin, et al.
0

Federated learning (FL) is a promising technical support to the vision of ubiquitous artificial intelligence in the sixth generation (6G) wireless communication network. However, traditional FL heavily relies on a trusted centralized server. Besides, FL is vulnerable to poisoning attacks, and the global aggregation of model updates makes the private training data under the risk of being reconstructed. What's more, FL suffers from efficiency problem due to heavy communication cost. Although decentralized FL eliminates the problem of the central dependence of traditional FL, it makes other problems more serious. In this paper, we propose BlockDFL, an efficient fully peer-to-peer (P2P) framework for decentralized FL. It integrates gradient compression and our designed voting mechanism with blockchain to efficiently coordinate multiple peer participants without mutual trust to carry out decentralized FL, while preventing data from being reconstructed according to transmitted model updates. Extensive experiments conducted on two real-world datasets exhibit that BlockDFL obtains competitive accuracy compared to centralized FL and can defend against poisoning attacks while achieving efficiency and scalability. Especially when the proportion of malicious participants is as high as 40 percent, BlockDFL can still preserve the accuracy of FL, which outperforms existing fully decentralized FL frameworks.

READ FULL TEXT

page 10

page 12

research
01/09/2021

Robust Blockchained Federated Learning with Model Validation and Proof-of-Stake Inspired Consensus

Federated learning (FL) is a promising distributed learning solution tha...
research
07/02/2023

Defending Against Malicious Behaviors in Federated Learning with Blockchain

In the era of deep learning, federated learning (FL) presents a promisin...
research
05/19/2021

Separation of Powers in Federated Learning

Federated Learning (FL) enables collaborative training among mutually di...
research
06/27/2021

Reward-Based 1-bit Compressed Federated Distillation on Blockchain

The recent advent of various forms of Federated Knowledge Distillation (...
research
08/18/2020

Deconstructing the Decentralization Trilemma

The vast majority of applications at this moment rely on centralized ser...
research
06/11/2023

FedDec: Peer-to-peer Aided Federated Learning

Federated learning (FL) has enabled training machine learning models exp...
research
04/20/2023

Get Rid Of Your Trail: Remotely Erasing Backdoors in Federated Learning

Federated Learning (FL) enables collaborative deep learning training acr...

Please sign up or login with your details

Forgot password? Click here to reset