Efficient Private Storage of Sparse Machine Learning Data

06/14/2022
by   Marvin Xhemrishi, et al.
0

We consider the problem of maintaining sparsity in private distributed storage of confidential machine learning data. In many applications, e.g., face recognition, the data used in machine learning algorithms is represented by sparse matrices which can be stored and processed efficiently. However, mechanisms maintaining perfect information-theoretic privacy require encoding the sparse matrices into randomized dense matrices. It has been shown that, under some restrictions on the storage nodes, sparsity can be maintained at the expense of relaxing the perfect information-theoretic privacy requirement, i.e., allowing some information leakage. In this work, we lift the restrictions imposed on the storage nodes and show that there exists a trade-off between sparsity and the achievable privacy guarantees. We focus on the setting of non-colluding nodes and construct a coding scheme that encodes the sparse input matrices into matrices with the desired sparsity level while limiting the information leakage.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/03/2022

Distributed Matrix-Vector Multiplication with Sparsity and Privacy Guarantees

We consider the problem of designing a coding scheme that allows both sp...
research
08/11/2023

Sparsity and Privacy in Secret Sharing: A Fundamental Trade-Off

This work investigates the design of sparse secret sharing schemes that ...
research
12/19/2022

Rate-Privacy-Storage Tradeoff in Federated Learning with Top r Sparsification

We investigate the trade-off between rate, privacy and storage in federa...
research
06/27/2023

Sparse and Private Distributed Matrix Multiplication with Straggler Tolerance

This paper considers the problem of outsourcing the multiplication of tw...
research
08/17/2020

Information-Theoretic Privacy in Federated Submodel learning

We consider information-theoretic privacy in federated submodel learning...
research
05/16/2018

Accuracy-Privacy Trade-off in Analyzing Randomized Responses

We consider the problem of analyzing a global property of private data, ...
research
07/15/2019

Single-Component Privacy Guarantees in Helper Data Systems and Sparse Coding

We investigate the privacy of two approaches to (biometric) template pro...

Please sign up or login with your details

Forgot password? Click here to reset