Distributed Differentially-Private Algorithms for Matrix and Tensor Factorization

04/26/2018
by   Hafiz Imtiaz, et al.
0

In many signal processing and machine learning applications, datasets containing private information are held at different locations, requiring the development of distributed privacy-preserving algorithms. Tensor and matrix factorizations are key components of many processing pipelines. In the distributed setting, differentially private algorithms suffer because they introduce noise to guarantee privacy. This paper designs new and improved distributed and differentially private algorithms for two popular matrix and tensor factorization methods: principal component analysis (PCA) and orthogonal tensor decomposition (OTD). The new algorithms employ a correlated noise design scheme to alleviate the effects of noise and can achieve the same noise level as the centralized scenario. Experiments on synthetic and real data illustrate the regimes in which the correlated noise allows performance matching with the centralized setting, outperforming previous methods and demonstrating that meaningful utility is possible while guaranteeing differential privacy.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/22/2019

Distributed Differentially Private Computation of Functions with Correlated Noise

Many applications of machine learning, such as human health research, in...
research
06/20/2016

Online and Differentially-Private Tensor Decomposition

In this paper, we resolve many of the key algorithmic questions regardin...
research
10/28/2019

Improved Differentially Private Decentralized Source Separation for fMRI Data

Blind source separation algorithms such as independent component analysi...
research
11/18/2015

Wishart Mechanism for Differentially Private Principal Components Analysis

We propose a new input perturbation mechanism for publishing a covarianc...
research
06/14/2023

PLAN: Variance-Aware Private Mean Estimation

Differentially private mean estimation is an important building block in...
research
07/12/2012

Near-Optimal Algorithms for Differentially-Private Principal Components

Principal components analysis (PCA) is a standard tool for identifying g...
research
05/12/2023

Differentially Private Set-Based Estimation Using Zonotopes

For large-scale cyber-physical systems, the collaboration of spatially d...

Please sign up or login with your details

Forgot password? Click here to reset