Privacy-Aware Compression for Federated Data Analysis

by   Kamalika Chaudhuri, et al.

Federated data analytics is a framework for distributed data analysis where a server compiles noisy responses from a group of distributed low-bandwidth user devices to estimate aggregate statistics. Two major challenges in this framework are privacy, since user data is often sensitive, and compression, since the user devices have low network bandwidth. Prior work has addressed these challenges separately by combining standard compression algorithms with known privacy mechanisms. In this work, we take a holistic look at the problem and design a family of privacy-aware compression mechanisms that work for any given communication budget. We first propose a mechanism for transmitting a single real number that has optimal variance under certain conditions. We then show how to extend it to metric differential privacy for location privacy use-cases, as well as vectors, for application to federated learning. Our experiments illustrate that our mechanism can lead to better utility vs. compression trade-offs for the same privacy loss in a number of settings.


page 6

page 16


SoteriaFL: A Unified Framework for Private Federated Learning with Communication Compression

To enable large-scale machine learning in bandwidth-hungry environments ...

Differential Privacy Meets Federated Learning under Communication Constraints

The performance of federated learning systems is bottlenecked by communi...

The Skellam Mechanism for Differentially Private Federated Learning

We introduce the multi-dimensional Skellam mechanism, a discrete differe...

Optimization of Privacy-Utility Trade-offs under Informational Self-determination

The pervasiveness of Internet of Things results in vast volumes of perso...

ProgFed: Effective, Communication, and Computation Efficient Federated Learning by Progressive Training

Federated learning is a powerful distributed learning scheme that allows...

Constrained Differential Privacy for Count Data

Concern about how to aggregate sensitive user data without compromising ...

Code Repositories


Code repo for the paper "Privacy-aware Compression for Federated Data Analysis".

view repo

Please sign up or login with your details

Forgot password? Click here to reset