Learning Anonymized Representations with Adversarial Neural Networks

02/26/2018
by   Clément Feutry, et al.
0

Statistical methods protecting sensitive information or the identity of the data owner have become critical to ensure privacy of individuals as well as of organizations. This paper investigates anonymization methods based on representation learning and deep neural networks, and motivated by novel information theoretical bounds. We introduce a novel training objective for simultaneously training a predictor over target variables of interest (the regular labels) while preventing an intermediate representation to be predictive of the private labels. The architecture is based on three sub-networks: one going from input to representation, one from representation to predicted regular labels, and one from representation to predicted private labels. The training procedure aims at learning representations that preserve the relevant part of the information (about regular labels) while dismissing information about the private labels which correspond to the identity of a person. We demonstrate the success of this approach for two distinct classification versus anonymization tasks (handwritten digits and sentiment analysis).

READ FULL TEXT
research
07/06/2019

I Am Not What I Write: Privacy Preserving Text Representation Learning

Online users generate tremendous amounts of textual information by parti...
research
04/03/2019

Differentially Private Model Publishing for Deep Learning

Deep learning techniques based on neural networks have shown significant...
research
06/14/2020

Adversarial representation learning for synthetic replacement of private attributes

The collection of large datasets allows for advanced analytics that can ...
research
09/19/2023

Disentangled Information Bottleneck guided Privacy-Protective JSCC for Image Transmission

Joint source and channel coding (JSCC) has attracted increasing attentio...
research
09/23/2020

Representation Learning from Limited Educational Data with Crowdsourced Labels

Representation learning has been proven to play an important role in the...
research
11/13/2019

Self-labelling via simultaneous clustering and representation learning

Combining clustering and representation learning is one of the most prom...
research
05/01/2017

Forced to Learn: Discovering Disentangled Representations Without Exhaustive Labels

Learning a better representation with neural networks is a challenging p...

Please sign up or login with your details

Forgot password? Click here to reset