Bayesian Inference for Gamma Models

06/03/2021
by   Jingyu He, et al.
11

We use the theory of normal variance-mean mixtures to derive a data augmentation scheme for models that include gamma functions. Our methodology applies to many situations in statistics and machine learning, including Multinomial-Dirichlet distributions, Negative binomial regression, Poisson-Gamma hierarchical models, Extreme value models, to name but a few. All of those models include a gamma function which does not admit a natural conjugate prior distribution providing a significant challenge to inference and prediction. To provide a data augmentation strategy, we construct and develop the theory of the class of Exponential Reciprocal Gamma distributions. This allows scalable EM and MCMC algorithms to be developed. We illustrate our methodology on a number of examples, including gamma shape inference, negative binomial regression and Dirichlet allocation. Finally, we conclude with directions for future research.

READ FULL TEXT

Authors

page 1

page 2

page 3

page 4

05/29/2019

Bayesian Inference for Polya Inverse Gamma Models

Probability density functions that include the gamma function are widely...
05/02/2012

Bayesian inference for logistic models using Polya-Gamma latent variables

We propose a new data-augmentation strategy for fully Bayesian inference...
03/03/2022

On Data Augmentation for Models Involving Reciprocal Gamma Functions

In this paper, we introduce a new and efficient data augmentation approa...
03/22/2019

Scalable Data Augmentation for Deep Learning

Scalable Data Augmentation (SDA) provides a framework for training deep ...
06/18/2021

Systemic Infinitesimal Over-dispersion on General Stochastic Graphical Models

Stochastic models of interacting populations have crucial roles in scien...
09/05/2012

Augment-and-Conquer Negative Binomial Processes

By developing data augmentation methods unique to the negative binomial ...
06/18/2015

Dependent Multinomial Models Made Easy: Stick Breaking with the Pólya-Gamma Augmentation

Many practical modeling problems involve discrete data that are best rep...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.