Private Learning and Regularized Optimal Transport

05/27/2019
by   Etienne Boursier, et al.
0

Private data are valuable either by remaining private (for instance if they are sensitive) or, on the other hand, by being used publicly to increase some utility. These two objectives are antagonistic and leaking data might be more rewarding than concealing them. Unlike classical concepts of privacy that focus on the first point, we consider instead agents that optimize a natural trade-off between both objectives. We formalize this as an optimization problem where the objective mapping is regularized by the amount of information leaked by the agent into the system (measured as a divergence between the prior and posterior on the private data). Quite surprisingly, when combined with the entropic regularization, the Sinkhorn divergence naturally emerges in the optimization objective, making it efficiently solvable. We apply these techniques to preserve some privacy in online repeated auctions.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/01/2021

Don't Generate Me: Training Differentially Private Generative Models with Sinkhorn Divergence

Although machine learning models trained on massive data have led to bre...
research
12/29/2021

Private Private Information

In a private private information structure, agents' signals contain no i...
research
01/16/2020

Arbitrarily Strong Utility-Privacy Trade-off in Decentralized Linear Estimation

Each agent in a network makes a local observation that is linearly relat...
research
06/11/2020

A Variational Approach to Privacy and Fairness

In this article, we propose a new variational approach to learn private ...
research
12/04/2017

Connecting Pixels to Privacy and Utility: Automatic Redaction of Private Information in Images

Images convey a broad spectrum of personal information. If such images a...
research
01/14/2022

Test-measured Rényi divergences

One possibility of defining a quantum Rényi α-divergence of two quantum ...
research
03/11/2021

Understanding the origin of information-seeking exploration in probabilistic objectives for control

The exploration-exploitation trade-off is central to the description of ...

Please sign up or login with your details

Forgot password? Click here to reset