Secure and Efficient Federated Learning Through Layering and Sharding Blockchain

04/27/2021
by   Shuo Yuan, et al.
0

Federated learning (FL) has emerged as a promising master/slave learning paradigm to alleviate systemic privacy risks and communication costs incurred by cloud-centric machine learning methods. However, it is very challenging to resist the single point of failure of the master aggregator and attacks from malicious participants while guaranteeing model convergence speed and accuracy. Recently, blockchain has been brought into FL systems transforming the paradigm to a decentralized manner thus further improve the system security and learning reliability. Unfortunately, the traditional consensus mechanism and architecture of blockchain systems can hardly handle the large-scale FL task due to the huge resource consumption, limited transaction throughput, and high communication complexity. To address these issues, this paper proposes a two-layer blockchaindriven FL framework, called as ChainsFL, which is composed of multiple subchain networks (subchain layer) and a direct acyclic graph (DAG)-based mainchain (mainchain layer). In ChainsFL, the subchain layer limits the scale of each shard for a small range of information exchange, and the mainchain layer allows each shard to share and validate the learning model in parallel and asynchronously to improve the efficiency of cross-shard validation. Furthermore, the FL procedure is customized to deeply integrate with blockchain technology, and the modified DAG consensus mechanism is proposed to mitigate the distortion caused by abnormal models. In order to provide a proof-ofconcept implementation and evaluation, multiple subchains base on Hyperledger Fabric are deployed as the subchain layer, and the self-developed DAG-based mainchain is deployed as the mainchain layer. The experimental results show that ChainsFL provides acceptable and sometimes better training efficiency and stronger robustness compared with the typical existing FL systems.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 1

page 5

page 9

04/27/2021

Towards On-Device Federated Learning: A Direct Acyclic Graph-based Blockchain Approach

Due to the distributed characteristics of Federated Learning (FL), the v...
01/09/2021

Robust Blockchained Federated Learning with Model Validation and Proof-of-Stake Inspired Consensus

Federated learning (FL) is a promising distributed learning solution tha...
09/20/2020

When Federated Learning Meets Blockchain: A New Distributed Learning Paradigm

Motivated by the advancing computational capabilities of wireless end us...
09/16/2019

BAFFLE : Blockchain based Aggregator Free Federated Learning

A key aspect of Federated Learning (FL) is the requirement of a centrali...
05/12/2020

A Secure Federated Learning Framework for 5G Networks

Federated Learning (FL) has been recently proposed as an emerging paradi...
12/31/2021

An Efficient and Robust Committee Structure for Sharding Blockchain

Nowadays, sharding is deemed as a promising way to save traditional bloc...
01/14/2022

Demystifying Swarm Learning: A New Paradigm of Blockchain-based Decentralized Federated Learning

Federated learning (FL) is an emerging promising privacy-preserving mach...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.