Fast Differentially Private Matrix Factorization

05/06/2015
by   Ziqi Liu, et al.
0

Differentially private collaborative filtering is a challenging task, both in terms of accuracy and speed. We present a simple algorithm that is provably differentially private, while offering good performance, using a novel connection of differential privacy to Bayesian posterior sampling via Stochastic Gradient Langevin Dynamics. Due to its simplicity the algorithm lends itself to efficient implementation. By careful systems design and by exploiting the power law behavior of the data to maximize CPU cache bandwidth we are able to generate 1024 dimensional models at a rate of 8.5 million recommendations per second on a single PC.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/11/2021

Can Stochastic Gradient Langevin Dynamics Provide Differential Privacy for Deep Learning?

Bayesian learning via Stochastic Gradient Langevin Dynamics (SGLD) has b...
research
09/12/2023

Deciding Differential Privacy of Online Algorithms with Multiple Variables

We consider the problem of checking the differential privacy of online r...
research
12/28/2017

Differentially Private Matrix Completion, Revisited

We study the problem of privacy-preserving collaborative filtering where...
research
12/05/2018

Differentially Private User-based Collaborative Filtering Recommendation Based on K-means Clustering

Collaborative filtering (CF) recommendation algorithms are well-known fo...
research
10/27/2020

Faster Differentially Private Samplers via Rényi Divergence Analysis of Discretized Langevin MCMC

Various differentially private algorithms instantiate the exponential me...
research
08/05/2020

Differentially Private Accelerated Optimization Algorithms

We present two classes of differentially private optimization algorithms...
research
02/26/2015

Privacy for Free: Posterior Sampling and Stochastic Gradient Monte Carlo

We consider the problem of Bayesian learning on sensitive datasets and p...

Please sign up or login with your details

Forgot password? Click here to reset