A Class of Conjugate Priors for Multinomial Probit Models which Includes the Multivariate Normal One

07/14/2020
by   Augusto Fasano, et al.
0

Multinomial probit models are widely-implemented representations which allow both classification and inference by learning changes in vectors of class probabilities with a set of p observed predictors. Although various frequentist methods have been developed for estimation, inference and classification within such a class of models, Bayesian inference is still lagging behind. This is due to the apparent absence of a tractable class of conjugate priors, that may facilitate posterior inference on the multinomial probit coefficients. Such an issue has motivated increasing efforts toward the development of effective Markov chain Monte Carlo methods, but state-of-the-art solutions still face severe computational bottlenecks, especially in large p settings. In this article, we prove that the entire class of unified skew-normal (SUN) distributions is conjugate to a wide variety of multinomial probit models, and we exploit the SUN properties to improve upon state-of-art-solutions for posterior inference and classification both in terms of closed-form results for key functionals of interest, and also by developing novel computational methods relying either on independent and identically distributed samples from the exact posterior or on scalable and accurate variational approximations based on blocked partially-factorized representations. As illustrated in a gastrointestinal lesions application, the magnitude of the improvements relative to current methods is particularly evident, in practice, when the focus is on large p applications.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/03/2020

Scalable computation of predictive probabilities in probit models with Gaussian process priors

Predictive models for binary data are fundamental in various fields, and...
research
06/16/2022

Bayesian conjugacy in probit, tobit, multinomial probit and extensions: A review and new results

A broad class of models that routinely appear in several fields can be e...
research
02/26/2018

Conjugate Bayes for probit regression via unified skew-normals

Regression models for dichotomous data are ubiquitous in statistics. Bes...
research
11/15/2019

Scalable and Accurate Variational Bayes for High-Dimensional Binary Regression Models

State-of-the-art methods for Bayesian inference on regression models wit...
research
11/19/2020

Variational Bayes Neural Network: Posterior Consistency, Classification Accuracy and Computational Challenges

Bayesian neural network models (BNN) have re-surged in recent years due ...
research
12/14/2018

Constrained Bayesian Inference through Posterior Projections

In a broad variety of settings, prior information takes the form of para...
research
11/15/2019

Asymptotically Exact Variational Bayes for High-Dimensional Binary Regression Models

State-of-the-art methods for Bayesian inference on regression models wit...

Please sign up or login with your details

Forgot password? Click here to reset