Geometric Conditions for the Discrepant Posterior Phenomenon and Connections to Simpson's Paradox

01/23/2020
by   Yang Chen, et al.
0

The discrepant posterior phenomenon (DPP) is a counterintuitive phenomenon that occurs in the Bayesian analysis of multivariate parameters. It refers to when an estimate of a marginal parameter obtained from the posterior is more extreme than both of those obtained using either the prior or the likelihood alone. Inferential claims that exhibit DPP defy intuition, and the phenomenon can be surprisingly ubiquitous in well-behaved Bayesian models. Using point estimation as an example, we derive conditions under which the DPP occurs in Bayesian models with exponential quadratic likelihoods, including Gaussian models and those with local asymptotic normality property, with conjugate multivariate Gaussian priors. We also examine the DPP for the Binomial model, in which the posterior mean is not a linear combination of that of the prior and the likelihood. We provide an intuitive geometric interpretation of the phenomenon and show that there exists a non-trivial space of marginal directions such that the DPP occurs. We further relate the phenomenon to the Simpson's paradox and discover their deep-rooted connection that is associated with marginalization. We also draw connections with Bayesian computational algorithms when difficult geometry exists. Theoretical results are complemented by numerical illustrations. Scenarios covered in this study have implications for parameterization, sensitivity analysis, and prior choice for Bayesian modeling.

READ FULL TEXT
research
04/13/2022

A Study on the Power Parameter in Power Prior Bayesian Analysis

The power prior and its variations have been proven to be a useful class...
research
02/01/2023

Necessary and sufficient conditions for posterior propriety for generalized linear mixed models

Generalized linear mixed models (GLMMs) are commonly used to analyze c...
research
04/09/2019

Bayesian variance estimation in the Gaussian sequence model with partial information on the means

Consider the Gaussian sequence model under the additional assumption tha...
research
07/11/2018

On Bayesian Estimation And Proximity Operators

There are two major routes to address the ubiquitous family of inverse p...
research
11/06/2019

Don't Blame the ELBO! A Linear VAE Perspective on Posterior Collapse

Posterior collapse in Variational Autoencoders (VAEs) arises when the va...
research
01/26/2020

On truncated multivariate normal priors in constrained parameter spaces

We show that any lower-dimensional marginal density obtained from trunca...
research
12/22/2018

Bayesian semiparametric modelling of phase-varying point processes

We propose a Bayesian semiparametric approach for modelling registration...

Please sign up or login with your details

Forgot password? Click here to reset