PD-ML-Lite: Private Distributed Machine Learning from Lighweight Cryptography

01/23/2019
by   Maksim Tsikhanovich, et al.
0

Privacy is a major issue in learning from distributed data. Recently the cryptographic literature has provided several tools for this task. However, these tools either reduce the quality/accuracy of the learning algorithm---e.g., by adding noise---or they incur a high performance penalty and/or involve trusting external authorities. We propose a methodology for private distributed machine learning from light-weight cryptography (in short, PD-ML-Lite). We apply our methodology to two major ML algorithms, namely non-negative matrix factorization (NMF) and singular value decomposition (SVD). Our resulting protocols are communication optimal, achieve the same accuracy as their non-private counterparts, and satisfy a notion of privacy---which we define---that is both intuitive and measurable. Our approach is to use lightweight cryptographic protocols (secure sum and normalized secure sum) to build learning algorithms rather than wrap complex learning algorithms in a heavy-cost MPC framework. We showcase our algorithms' utility and privacy on several applications: for NMF we consider topic modeling and recommender systems, and for SVD, principal component regression, and low rank approximation.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/02/2021

A Survey of Latent Factor Models for Recommender Systems and Personalization

Recommender systems aim to personalize the experience of a user and are ...
research
07/11/2018

Improved SVD-based Initialization for Nonnegative Matrix Factorization using Low-Rank Correction

Due to the iterative nature of most nonnegative matrix factorization (NM...
research
02/15/2016

Secure Approximation Guarantee for Cryptographically Private Empirical Risk Minimization

Privacy concern has been increasingly important in many machine learning...
research
12/06/2017

An Efficient Algorithm for Non-Negative Matrix Factorization with Random Projections

Non-negative matrix factorization (NMF) is one of the most popular decom...
research
04/16/2019

PL-NMF: Parallel Locality-Optimized Non-negative Matrix Factorization

Non-negative Matrix Factorization (NMF) is a key kernel for unsupervised...
research
06/19/2023

Few-shot Learning for Inference in Medical Imaging with Subspace Feature Representations

Unlike the field of visual scene recognition where tremendous advances h...

Please sign up or login with your details

Forgot password? Click here to reset