Bayesian Multinomial Logistic Regression for Numerous Categories

08/30/2022
by   Jared D. Fisher, et al.
0

While multinomial logistic regression is a useful tool for classification among multiple categories, the posterior sampling of Bayesian implementations is computationally burdensome when the number of categories is large. In this paper, we show that the appropriate data augmentation technique provides faster posterior sampling than alternatives in the literature. This speed up comes from two sources: simpler posterior conditional distributions on the coefficients and the ability to parallelize parameter draws. In simulation studies, we demonstrate that the effective sampling rate of our posterior sampling approach is double that of competing methods when working with a large number of categories, even without parallelized computations. Furthermore, this computation time only increases linearly as the number of categories increases. Our corresponding R package is available on Github.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/17/2018

Geometric ergodicity of Polya-Gamma Gibbs sampler for Bayesian logistic regression with a flat prior

Logistic regression model is the most popular model for analyzing binary...
research
12/04/2019

Bayesian Group Selection in Logistic Regression with Application to MRI Data Analysis

We consider Bayesian logistic regression models with group-structured co...
research
01/15/2021

A Bayesian perspective on sampling of alternatives

In this paper, we apply a Bayesian perspective to sampling of alternativ...
research
06/01/2018

Bayesian Logistic Regression for Small Areas with Numerous Households

We analyze binary data, available for a relatively large number (big dat...
research
05/31/2022

Easy Variational Inference for Categorical Models via an Independent Binary Approximation

We pursue tractable Bayesian analysis of generalized linear models (GLMs...
research
01/16/2019

Multivariate mixed membership modeling: Inferring domain-specific risk profiles

Characterizing shared membership of individuals in two or more categorie...

Please sign up or login with your details

Forgot password? Click here to reset