Efficient Batch Homomorphic Encryption for Vertically Federated XGBoost

12/08/2021
by   Wuxing Xu, et al.
0

More and more orgainizations and institutions make efforts on using external data to improve the performance of AI services. To address the data privacy and security concerns, federated learning has attracted increasing attention from both academia and industry to securely construct AI models across multiple isolated data providers. In this paper, we studied the efficiency problem of adapting widely used XGBoost model in real-world applications to vertical federated learning setting. State-of-the-art vertical federated XGBoost frameworks requires large number of encryption operations and ciphertext transmissions, which makes the model training much less efficient than training XGBoost models locally. To bridge this gap, we proposed a novel batch homomorphic encryption method to cut the cost of encryption-related computation and transmission in nearly half. This is achieved by encoding the first-order derivative and the second-order derivative into a single number for encryption, ciphertext transmission, and homomorphic addition operations. The sum of multiple first-order derivatives and second-order derivatives can be simultaneously decoded from the sum of encoded values. We are motivated by the batch idea in the work of BatchCrypt for horizontal federated learning, and design a novel batch method to address the limitations of allowing quite few number of negative numbers. The encode procedure of the proposed batch method consists of four steps, including shifting, truncating, quantizing and batching, while the decoding procedure consists of de-quantization and shifting back. The advantages of our method are demonstrated through theoretical analysis and extensive numerical experiments.

READ FULL TEXT
research
12/01/2019

A Quasi-Newton Method Based Vertical Federated Learning Framework for Logistic Regression

Data privacy and security becomes a major concern in building machine le...
research
05/15/2023

Quadratic Functional Encryption for Secure Training in Vertical Federated Learning

Vertical federated learning (VFL) enables the collaborative training of ...
research
01/17/2022

EFMVFL: An Efficient and Flexible Multi-party Vertical Federated Learning without a Third Party

Federated learning allows multiple participants to conduct joint modelin...
research
02/10/2023

XFL: A High Performace, Lightweighted Federated Learning Framework

This paper introduces XFL, an industrial-grade federated learning projec...
research
01/23/2020

RPN: A Residual Pooling Network for Efficient Federated Learning

Federated learning is a new machine learning framework which enables dif...
research
07/19/2022

Is Vertical Logistic Regression Privacy-Preserving? A Comprehensive Privacy Analysis and Beyond

We consider vertical logistic regression (VLR) trained with mini-batch g...

Please sign up or login with your details

Forgot password? Click here to reset