A Hybrid Approach to Privacy-Preserving Federated Learning

12/07/2018
by   Stacey Truex, et al.
0

Training machine learning models often requires data from multiple parties. However, in some cases, data owners cannot share their data due to legal or privacy constraints but would still benefit from training a model jointly with multiple parties. Federated learning has arisen as an alternative to allow for the collaborative training of models without the sharing of raw data. However, attacks in the literature have demonstrated that simply maintaining data locally during training processes does not provide strong enough privacy guarantees. We need a federated learning system capable of preventing inference over the messages exchanged between parties during training as well as the final, trained model, considering potential collusion between parties, and ensuring the resulting machine learning model has acceptable predictive accuracy. Currently, existing approaches are either vulnerable to inference or do not scale for a large number of parties, resulting in models with low accuracy. To close this gap, we present a scalable approach that protects against these threats while producing models with high accuracy. Our approach provides formal data privacy guarantees using both differential privacy and secure multiparty computation frameworks. We validate our system with experimental results on two popular and significantly different machine learning algorithms: decision trees and convolutional neural networks. To the best of our knowledge, this presents the first approach to accurately train a neural network in a private, federated fashion. Our experiments demonstrate that our approach outperforms state of the art solutions in accuracy, customizability, and scalability.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/11/2019

Practical Federated Gradient Boosting Decision Trees

Gradient Boosting Decision Trees (GBDTs) have become very successful in ...
research
06/24/2021

Privacy Threats Analysis to Secure Federated Learning

Federated learning is emerging as a machine learning technique that trai...
research
12/24/2019

Cronus: Robust and Heterogeneous Collaborative Learning with Black-Box Knowledge Transfer

Collaborative (federated) learning enables multiple parties to train a m...
research
06/03/2019

Federated Hierarchical Hybrid Networks for Clickbait Detection

Online media outlets adopt clickbait techniques to lure readers to click...
research
05/05/2023

Data Station: Delegated, Trustworthy, and Auditable Computation to Enable Data-Sharing Consortia with a Data Escrow

Pooling and sharing data increases and distributes its value. But since ...
research
03/27/2023

PADME-SoSci: A Platform for Analytics and Distributed Machine Learning for the Social Sciences

Data privacy and ownership are significant in social data science, raisi...
research
10/31/2022

Mahiru: a federated, policy-driven data processing and exchange system

Secure, privacy-preserving sharing of scientific or business data is cur...

Please sign up or login with your details

Forgot password? Click here to reset