Block Gibbs samplers for logistic mixed models: convergence properties and a comparison with full Gibbs samplers

01/11/2021
by   Yalin Rao, et al.
0

Logistic linear mixed model (LLMM) is one of the most widely used statistical models. Generally, Markov chain Monte Carlo algorithms are used to explore the posterior densities associated with Bayesian LLMMs. Polson, Scott and Windle's (2013) Polya-Gamma data augmentation (DA) technique can be used to construct full Gibbs (FG) samplers for LLMMs. Here, we develop efficient block Gibbs (BG) samplers for Bayesian LLMMs using the Polya-Gamma DA method. We compare the FG and BG samplers in the context of simulated and real data examples as the correlation between the fixed and random effects changes as well as when the dimensions of the design matrices vary. These numerical examples demonstrate superior performance of the BG samplers over the FG samplers. We also derive conditions guaranteeing geometric ergodicity of the BG Markov chain when the popular improper uniform prior is assigned on the regression coefficients and proper or improper priors are placed on the variance parameters of the random effects. This theoretical result has important practical implications as it justifies the use of asymptotically valid Monte Carlo standard errors for Markov chain based estimates of posterior quantities.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/25/2020

Multilevel Gibbs Sampling for Bayesian Regression

Bayesian regression remains a simple but effective tool based on Bayesia...
research
11/18/2019

A Distributed Algorithm for Polya-Gamma Data Augmentation

The Polya-Gamma data augmentation (PG-DA) algorithm is routinely used fo...
research
02/17/2018

Geometric ergodicity of Polya-Gamma Gibbs sampler for Bayesian logistic regression with a flat prior

Logistic regression model is the most popular model for analyzing binary...
research
04/13/2019

Pólygamma Data Augmentation to address Non-conjugacy in the Bayesian Estimation of Mixed Multinomial Logit Models

The standard Gibbs sampler of Mixed Multinomial Logit (MMNL) models invo...
research
12/20/2021

Convergence properties of data augmentation algorithms for high-dimensional robit regression

The logistic and probit link functions are the most common choices for r...
research
09/06/2019

Bayesian Semiparametric Estimation with Nonignorable Nonresponse

Statistical inference with nonresponse is quite challenging, especially ...
research
12/14/2022

Analysis of block slice samplers for Bayesian GLMMs and GAMs with linear inequality and shape constraints

Exponential family models, generalized linear models (GLMs), generalized...

Please sign up or login with your details

Forgot password? Click here to reset