A Quasi-Newton Method Based Vertical Federated Learning Framework for Logistic Regression

12/01/2019
by   Kai Yang, et al.
13

Data privacy and security becomes a major concern in building machine learning models from different data providers. Federated learning shows promise by leaving data at providers locally and exchanging encrypted information. This paper studies the vertical federated learning structure for logistic regression where the data sets at two parties have the same sample IDs but own disjoint subsets of features. Existing frameworks adopt the first-order stochastic gradient descent algorithm, which requires large number of communication rounds. To address the communication challenge, we propose a quasi-Newton method based vertical federated learning framework for logistic regression under the additively homomorphic encryption scheme. Our approach can considerably reduce the number of communication rounds with a little additional communication cost per round. Numerical results demonstrate the advantages of our approach over the first-order method.

READ FULL TEXT

page 1

page 2

page 3

page 4

page 5

research
01/23/2021

Vertical federated learning based on DFP and BFGS

As data privacy is gradually valued by people, federated learning(FL) ha...
research
12/24/2019

A Communication Efficient Vertical Federated Learning Framework

One critical challenge for applying today's Artificial Intelligence (AI)...
research
05/27/2023

Federated Empirical Risk Minimization via Second-Order Method

Many convex optimization problems with important applications in machine...
research
12/08/2021

Efficient Batch Homomorphic Encryption for Vertically Federated XGBoost

More and more orgainizations and institutions make efforts on using exte...
research
10/26/2022

Coresets for Vertical Federated Learning: Regularized Linear Regression and K-Means Clustering

Vertical federated learning (VFL), where data features are stored in mul...
research
09/17/2021

Achieving Model Fairness in Vertical Federated Learning

Vertical federated learning (VFL), which enables multiple enterprises po...
research
09/26/2021

AsySQN: Faster Vertical Federated Learning Algorithms with Better Computation Resource Utilization

Vertical federated learning (VFL) is an effective paradigm of training t...

Please sign up or login with your details

Forgot password? Click here to reset