Skew-Normal Posterior Approximations

02/16/2023
by   Jackson Zhou, et al.
0

Many approximate Bayesian inference methods assume a particular parametric form for approximating the posterior distribution. A multivariate Gaussian distribution provides a convenient density for such approaches; examples include the Laplace, penalized quasi-likelihood, Gaussian variational, and expectation propagation methods. Unfortunately, these all ignore the potential skewness of the posterior distribution. We propose a modification that accounts for skewness, where key statistics of the posterior distribution are matched instead to a multivariate skew-normal distribution. A combination of simulation studies and benchmarking were conducted to compare the performance of this skew-normal matching method (both as a standalone approximation and as a post-hoc skewness adjustment) with existing Gaussian and skewed approximations. We show empirically that for small and moderate dimensional cases, skew-normal matching can be much more accurate than these other approaches. For post-hoc skewness adjustments, this comes at very little cost in additional computational time.

READ FULL TEXT

page 32

page 33

page 38

page 39

research
04/16/2019

High-dimensional copula variational approximation through transformation

Variational methods are attractive for computing Bayesian inference for ...
research
11/19/2019

A Normal Approximation Method for Statistics in Knockouts

The authors give an approximation method for Bayesian inference in arena...
research
10/18/2018

Expectation Propagation for Poisson Data

The Poisson distribution arises naturally when dealing with data involvi...
research
01/04/2023

Comparison of Azzalini and Geometric Skew Normal Distributions Under Bayesian Paradigm

Skewed generalizations of the normal distribution have been a topic of g...
research
09/04/2023

Efficient expectation propagation for posterior approximation in high-dimensional probit models

Bayesian binary regression is a prosperous area of research due to the c...
research
01/10/2022

Loss-calibrated expectation propagation for approximate Bayesian decision-making

Approximate Bayesian inference methods provide a powerful suite of tools...
research
02/21/2022

Non-Volatile Memory Accelerated Posterior Estimation

Bayesian inference allows machine learning models to express uncertainty...

Please sign up or login with your details

Forgot password? Click here to reset