Coresets for Vertical Federated Learning: Regularized Linear Regression and K-Means Clustering

10/26/2022
by   Lingxiao Huang, et al.
0

Vertical federated learning (VFL), where data features are stored in multiple parties distributively, is an important area in machine learning. However, the communication complexity for VFL is typically very high. In this paper, we propose a unified framework by constructing coresets in a distributed fashion for communication-efficient VFL. We study two important learning tasks in the VFL setting: regularized linear regression and k-means clustering, and apply our coreset framework to both problems. We theoretically show that using coresets can drastically alleviate the communication complexity, while nearly maintain the solution quality. Numerical experiments are conducted to corroborate our theoretical findings.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/01/2022

Hijack Vertical Federated Learning Models with Adversarial Embedding

Vertical federated learning (VFL) is an emerging paradigm that enables c...
research
12/01/2019

A Quasi-Newton Method Based Vertical Federated Learning Framework for Logistic Regression

Data privacy and security becomes a major concern in building machine le...
research
06/10/2021

Multi-VFL: A Vertical Federated Learning System for Multiple Data and Label Owners

Vertical Federated Learning (VFL) refers to the collaborative training o...
research
06/14/2020

The OARF Benchmark Suite: Characterization and Implications for Federated Learning Systems

This paper presents and characterizes an Open Application Repository for...
research
08/16/2021

Fine-tuning is Fine in Federated Learning

We study the performance of federated learning algorithms and their vari...
research
03/06/2021

Linear Regression over Networks with Communication Guarantees

A key functionality of emerging connected autonomous systems such as sma...
research
01/25/2021

Adaptive Scheduling for Machine Learning Tasks over Networks

A key functionality of emerging connected autonomous systems such as sma...

Please sign up or login with your details

Forgot password? Click here to reset