Adversarial Classification under Gaussian Mechanism: Calibrating the Attack to Sensitivity

01/24/2022
by   Ayşe Ünsal, et al.
0

This work studies anomaly detection under differential privacy with Gaussian perturbation using both statistical and information-theoretic tools. In our setting, the adversary aims to modify the content of a statistical dataset by inserting additional data without being detected using the differential privacy to her/his own benefit. To this end, firstly via hypothesis testing, we characterize a statistical threshold for the adversary, which balances the privacy budget and the induced bias (the impact of the attack) in order to remain undetected. In addition, we establish the privacy-distortion trade-off in the sense of the well-known rate-distortion function for the Gaussian mechanism by using an information-theoretic approach to avoid detection. Accordingly, we derive an upper bound on the variance of the attacker's additional data as a function of the sensitivity and the original data's second-order statistics. Lastly, we introduce a new privacy metric based on Chernoff information for classifying adversaries under differential privacy as a stronger alternative for the Gaussian mechanism. Analytical results are supported by numerical evaluations.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/22/2022

Information-Theoretic Approaches to Differential Privacy

The tutorial studies relationships between differential privacy and vari...
research
05/12/2021

A Statistical Threshold for Adversarial Classification in Laplace Mechanisms

This paper studies the statistical characterization of detecting an adve...
research
02/24/2023

Privacy Against Hypothesis-Testing Adversaries for Quantum Computing

A novel definition for data privacy in quantum computing based on quantu...
research
10/13/2021

Offset-Symmetric Gaussians for Differential Privacy

The Gaussian distribution is widely used in mechanism design for differe...
research
08/14/2019

Taking a Lesson from Quantum Particles for Statistical Data Privacy

Privacy is under threat from artificial intelligence revolution fueled b...
research
11/16/2019

Robust Anomaly Detection and Backdoor Attack Detection Via Differential Privacy

Outlier detection and novelty detection are two important topics for ano...
research
01/20/2023

On the Relationship Between Information-Theoretic Privacy Metrics And Probabilistic Information Privacy

Information-theoretic (IT) measures based on f-divergences have recently...

Please sign up or login with your details

Forgot password? Click here to reset