FedVS: Straggler-Resilient and Privacy-Preserving Vertical Federated Learning for Split Models

04/26/2023
by   Songze Li, et al.
0

In a vertical federated learning (VFL) system consisting of a central server and many distributed clients, the training data are vertically partitioned such that different features are privately stored on different clients. The problem of split VFL is to train a model split between the server and the clients. This paper aims to address two major challenges in split VFL: 1) performance degradation due to straggling clients during training; and 2) data and model privacy leakage from clients' uploaded data embeddings. We propose FedVS to simultaneously address these two challenges. The key idea of FedVS is to design secret sharing schemes for the local data and models, such that information-theoretical privacy against colluding clients and curious server is guaranteed, and the aggregation of all clients' embeddings is reconstructed losslessly, via decrypting computation shares from the non-straggling clients. Extensive experiments on various types of VFL datasets (including tabular, CV, and multi-view) demonstrate the universal advantages of FedVS in straggler mitigation and privacy protection over baseline protocols.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/23/2020

Practical and Bilateral Privacy-preserving Federated Learning

Federated learning, as an emerging distributed training model of neural ...
research
06/28/2023

Secure and Fast Asynchronous Vertical Federated Learning via Cascaded Hybrid Optimization

Vertical Federated Learning (VFL) attracts increasing attention because ...
research
08/22/2020

Multiple Classification with Split Learning

Privacy issues were raised in the process of training deep learning in m...
research
05/05/2021

Byzantine-Robust and Privacy-Preserving Framework for FedML

Federated learning has emerged as a popular paradigm for collaboratively...
research
06/10/2022

Binarizing Split Learning for Data Privacy Enhancement and Computation Reduction

Split learning (SL) enables data privacy preservation by allowing client...
research
05/04/2021

Federated Multi-View Learning for Private Medical Data Integration and Analysis

Along with the rapid expansion of information technology and digitalizat...
research
11/06/2020

FedSL: Federated Split Learning on Distributed Sequential Data in Recurrent Neural Networks

Federated Learning (FL) and Split Learning (SL) are privacy-preserving M...

Please sign up or login with your details

Forgot password? Click here to reset