Privacy-Aware Compression for Federated Data Analysis

03/15/2022
by   Kamalika Chaudhuri, et al.
Facebook
0

Federated data analytics is a framework for distributed data analysis where a server compiles noisy responses from a group of distributed low-bandwidth user devices to estimate aggregate statistics. Two major challenges in this framework are privacy, since user data is often sensitive, and compression, since the user devices have low network bandwidth. Prior work has addressed these challenges separately by combining standard compression algorithms with known privacy mechanisms. In this work, we take a holistic look at the problem and design a family of privacy-aware compression mechanisms that work for any given communication budget. We first propose a mechanism for transmitting a single real number that has optimal variance under certain conditions. We then show how to extend it to metric differential privacy for location privacy use-cases, as well as vectors, for application to federated learning. Our experiments illustrate that our mechanism can lead to better utility vs. compression trade-offs for the same privacy loss in a number of settings.

READ FULL TEXT

page 6

page 16

06/20/2022

SoteriaFL: A Unified Framework for Private Federated Learning with Communication Compression

To enable large-scale machine learning in bandwidth-hungry environments ...
01/28/2021

Differential Privacy Meets Federated Learning under Communication Constraints

The performance of federated learning systems is bottlenecked by communi...
10/11/2021

The Skellam Mechanism for Differentially Private Federated Learning

We introduce the multi-dimensional Skellam mechanism, a discrete differe...
10/09/2017

Optimization of Privacy-Utility Trade-offs under Informational Self-determination

The pervasiveness of Internet of Things results in vast volumes of perso...
10/11/2021

ProgFed: Effective, Communication, and Computation Efficient Federated Learning by Progressive Training

Federated learning is a powerful distributed learning scheme that allows...
10/02/2017

Constrained Differential Privacy for Count Data

Concern about how to aggregate sensitive user data without compromising ...

Code Repositories

dp_compression

Code repo for the paper "Privacy-aware Compression for Federated Data Analysis".


view repo

Please sign up or login with your details

Forgot password? Click here to reset