Advancements of federated learning towards privacy preservation: from federated learning to split learning

11/25/2020
by   Chandra Thapa, et al.
0

In the distributed collaborative machine learning (DCML) paradigm, federated learning (FL) recently attracted much attention due to its applications in health, finance, and the latest innovations such as industry 4.0 and smart vehicles. FL provides privacy-by-design. It trains a machine learning model collaboratively over several distributed clients (ranging from two to millions) such as mobile phones, without sharing their raw data with any other participant. In practical scenarios, all clients do not have sufficient computing resources (e.g., Internet of Things), the machine learning model has millions of parameters, and its privacy between the server and the clients while training/testing is a prime concern (e.g., rival parties). In this regard, FL is not sufficient, so split learning (SL) is introduced. SL is reliable in these scenarios as it splits a model into multiple portions, distributes them among clients and server, and trains/tests their respective model portions to accomplish the full model training/testing. In SL, the participants do not share both data and their model portions to any other parties, and usually, a smaller network portion is assigned to the clients where data resides. Recently, a hybrid of FL and SL, called splitfed learning, is introduced to elevate the benefits of both FL (faster training/testing time) and SL (model split and training). Following the developments from FL to SL, and considering the importance of SL, this chapter is designed to provide extensive coverage in SL and its variants. The coverage includes fundamentals, existing findings, integration with privacy measures such as differential privacy, open problems, and code implementation.

READ FULL TEXT
research
04/25/2020

SplitFed: When Federated Learning Meets Split Learning

Federated learning (FL) and split learning (SL) are two recent distribut...
research
10/12/2020

Oort: Informed Participant Selection for Scalable Federated Learning

Federated Learning (FL) is an emerging direction in distributed machine ...
research
07/15/2022

Introducing Federated Learning into Internet of Things ecosystems – preliminary considerations

Federated learning (FL) was proposed to facilitate the training of model...
research
06/07/2022

Group privacy for personalized federated learning

Federated learning is a type of collaborative machine learning, where pa...
research
09/19/2021

Splitfed learning without client-side synchronization: Analyzing client-side split network portion size to overall performance

Federated Learning (FL), Split Learning (SL), and SplitFed Learning (SFL...
research
06/10/2022

Binarizing Split Learning for Data Privacy Enhancement and Computation Reduction

Split learning (SL) enables data privacy preservation by allowing client...
research
07/08/2019

Privacy-Preserving Classification with Secret Vector Machines

Today, large amounts of valuable data are distributed among millions of ...

Please sign up or login with your details

Forgot password? Click here to reset