Mitigating Leakage from Data Dependent Communications in Decentralized Computing using Differential Privacy

12/23/2021
by   Riad Ladjel, et al.
0

Imagine a group of citizens willing to collectively contribute their personal data for the common good to produce socially useful information, resulting from data analytics or machine learning computations. Sharing raw personal data with a centralized server performing the computation could raise concerns about privacy and a perceived risk of mass surveillance. Instead, citizens may trust each other and their own devices to engage into a decentralized computation to collaboratively produce an aggregate data release to be shared. In the context of secure computing nodes exchanging messages over secure channels at runtime, a key security issue is to protect against external attackers observing the traffic, whose dependence on data may reveal personal information. Existing solutions are designed for the cloud setting, with the goal of hiding all properties of the underlying dataset, and do not address the specific privacy and efficiency challenges that arise in the above context. In this paper, we define a general execution model to control the data-dependence of communications in user-side decentralized computations, in which differential privacy guarantees for communication patterns in global execution plans can be analyzed by combining guarantees obtained on local clusters of nodes. We propose a set of algorithms which allow to trade-off between privacy, utility and efficiency. Our formal privacy guarantees leverage and extend recent results on privacy amplification by shuffling. We illustrate the usefulness of our proposal on two representative examples of decentralized execution plans with data-dependent communications.

READ FULL TEXT
research
02/11/2019

Drynx: Decentralized, Secure, Verifiable System for Statistical Queries and Machine Learning on Distributed Datasets

Data sharing has become of primary importance in many domains such as bi...
research
06/10/2022

Muffliato: Peer-to-Peer Privacy Amplification for Decentralized Optimization and Averaging

Decentralized optimization is increasingly popular in machine learning f...
research
04/08/2022

Network Shuffling: Privacy Amplification via Random Walks

Recently, it is shown that shuffling can amplify the central differentia...
research
11/03/2019

Privacy for Free: Communication-Efficient Learning with Differential Privacy Using Sketches

Communication and privacy are two critical concerns in distributed learn...
research
10/18/2020

Decentralized and Secure Generation Maintenance with Differential Privacy

Decentralized methods are gaining popularity for data-driven models in p...
research
12/09/2020

Privacy Amplification by Decentralization

Analyzing data owned by several parties while achieving a good trade-off...
research
04/05/2018

Spatio-temporal Trajectory Dataset Privacy Based on Network Traffic Control

Collection of user's location and trajectory information that contains r...

Please sign up or login with your details

Forgot password? Click here to reset