Multi-VFL: A Vertical Federated Learning System for Multiple Data and Label Owners

06/10/2021
by   Vaikkunth Mugunthan, et al.
0

Vertical Federated Learning (VFL) refers to the collaborative training of a model on a dataset where the features of the dataset are split among multiple data owners, while label information is owned by a single data owner. In this paper, we propose a novel method, Multi Vertical Federated Learning (Multi-VFL), to train VFL models when there are multiple data and label owners. Our approach is the first to consider the setting where D-data owners (across which features are distributed) and K-label owners (across which labels are distributed) exist. This proposed configuration allows different entities to train and learn optimal models without having to share their data. Our framework makes use of split learning and adaptive federated optimizers to solve this problem. For empirical evaluation, we run experiments on the MNIST and FashionMNIST datasets. Our results show that using adaptive optimizers for model aggregation fastens convergence and improves accuracy.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/01/2021

PyVertical: A Vertical Federated Learning Framework for Multi-headed SplitNN

We introduce PyVertical, a framework supporting vertical federated learn...
research
02/27/2023

FLAG: Fast Label-Adaptive Aggregation for Multi-label Classification in Federated Learning

Federated learning aims to share private data to maximize the data utili...
research
08/07/2020

SplitNN-driven Vertical Partitioning

In this work, we introduce SplitNN-driven Vertical Partitioning, a confi...
research
05/29/2023

Reducing Communication for Split Learning by Randomized Top-k Sparsification

Split learning is a simple solution for Vertical Federated Learning (VFL...
research
11/06/2020

Resource-Constrained Federated Learning with Heterogeneous Labels and Models

Various IoT applications demand resource-constrained machine learning me...
research
10/26/2022

Coresets for Vertical Federated Learning: Regularized Linear Regression and K-Means Clustering

Vertical federated learning (VFL), where data features are stored in mul...
research
07/05/2023

VertiBench: Advancing Feature Distribution Diversity in Vertical Federated Learning Benchmarks

Vertical Federated Learning (VFL) is a crucial paradigm for training mac...

Please sign up or login with your details

Forgot password? Click here to reset