Permuted and Augmented Stick-Breaking Bayesian Multinomial Regression

12/30/2016
by   Quan Zhang, et al.
0

To model categorical response variables given their covariates, we propose a permuted and augmented stick-breaking (paSB) construction that one-to-one maps the observed categories to randomly permuted latent sticks. This new construction transforms multinomial regression into regression analysis of stick-specific binary random variables that are mutually independent given their covariate-dependent stick success probabilities, which are parameterized by the regression coefficients of their corresponding categories. The paSB construction allows transforming an arbitrary cross-entropy-loss binary classifier into a Bayesian multinomial one. Specifically, we parameterize the negative logarithms of the stick failure probabilities with a family of covariate-dependent softplus functions to construct nonparametric Bayesian multinomial softplus regression, and transform Bayesian support vector machine (SVM) into Bayesian multinomial SVM. These Bayesian multinomial regression models are not only capable of providing probability estimates, quantifying uncertainty, and producing nonlinear classification decision boundaries, but also amenable to posterior simulation. Example results demonstrate their attractive properties and appealing performance.

READ FULL TEXT

page 23

page 24

page 26

research
08/04/2022

Tree stick-breaking priors for covariate-dependent mixture models

Stick-breaking priors are often adopted in Bayesian nonparametric mixtur...
research
08/23/2016

Softplus Regressions and Convex Polytopes

To construct flexible nonlinear predictive distributions, the paper intr...
research
07/23/2020

A binary-response regression model based on support vector machines

The soft-margin support vector machine (SVM) is a ubiquitous tool for pr...
research
04/09/2018

On marginal and conditional parameters in logistic regression models

A fundamental research question is how much a variation in a covariate i...
research
05/17/2019

Colombian Women's Life Patterns: A Multivariate Density Regression Approach

Women in Latin America and the Caribbean face difficulties related to th...
research
12/24/2020

Dependence of variance on covariate design in nonparametric link regression

This note discusses a nonparametric approach to link regression aiming a...
research
01/31/2019

Bayesian nonparametric multiway regression for clustered binomial data

We introduce a Bayesian nonparametric regression model for data with mul...

Please sign up or login with your details

Forgot password? Click here to reset