DeepAI AI Chat
Log In Sign Up

Private Posterior distributions from Variational approximations

by   Vishesh Karwa, et al.

Privacy preserving mechanisms such as differential privacy inject additional randomness in the form of noise in the data, beyond the sampling mechanism. Ignoring this additional noise can lead to inaccurate and invalid inferences. In this paper, we incorporate the privacy mechanism explicitly into the likelihood function by treating the original data as missing, with an end goal of estimating posterior distributions over model parameters. This leads to a principled way of performing valid statistical inference using private data, however, the corresponding likelihoods are intractable. In this paper, we derive fast and accurate variational approximations to tackle such intractable likelihoods that arise due to privacy. We focus on estimating posterior distributions of parameters of the naive Bayes log-linear model, where the sufficient statistics of this model are shared using a differentially private interface. Using a simulation study, we show that the posterior approximations outperform the naive method of ignoring the noise addition mechanism.


page 1

page 2

page 3

page 4


Data Augmentation MCMC for Bayesian Inference from Privatized Data

Differentially private mechanisms protect privacy by introducing additio...

Differentially Private Statistical Inference through β-Divergence One Posterior Sampling

Differential privacy guarantees allow the results of a statistical analy...

The Tangent Exponential Model

The likelihood function is central to both frequentist and Bayesian form...

Variational Bayes In Private Settings (VIPS)

We provide a general framework for privacy-preserving variational Bayes ...

Robust posterior inference when statistically emulating forward simulations

Scientific analyses often rely on slow, but accurate forward models for ...

Private Topic Modeling

We develop a privatised stochastic variational inference method for Late...

Differentially Private Optimal Power Flow for Distribution Grids

Although distribution grid customers are obliged to share their consumpt...