Bayesian Inference for Generalized Linear Model with Linear Inequality Constraints

08/24/2021
by   Rahul Ghosal, et al.
0

Bayesian statistical inference for Generalized Linear Models (GLMs) with parameters lying on a constrained space is of general interest (e.g., in monotonic or convex regression), but often constructing valid prior distributions supported on a subspace spanned by a set of linear inequality constraints can be challenging, especially when some of the constraints might be binding leading to a lower dimensional subspace. For the general case with canonical link, it is shown that a generalized truncated multivariate normal supported on a desired subspace can be used. Moreover, it is shown that such prior distribution facilitates the construction of a general purpose product slice sampling method to obtain (approximate) samples from corresponding posterior distribution, making the inferential method computationally efficient for a wide class of GLMs with an arbitrary set of linear inequality constraints. The proposed product slice sampler is shown to be uniformly ergodic, having a geometric convergence rate under a set of mild regularity conditions satisfied by many popular GLMs (e.g., logistic and Poisson regressions with constrained coefficients). One of the primary advantages of the proposed Bayesian estimation method over classical methods is that uncertainty of parameter estimates is easily quantified by using the samples simulated from the path of the Markov Chain of the slice sampler. Numerical illustrations using simulated data sets are presented to illustrate the superiority of the proposed methods compared to some existing methods in terms of sampling bias and variances. In addition, real case studies are presented using data sets for fertilizer-crop production and estimating the SCRAM rate in nuclear power plants.

READ FULL TEXT
research
12/14/2022

Analysis of block slice samplers for Bayesian GLMMs and GAMs with linear inequality and shape constraints

Exponential family models, generalized linear models (GLMs), generalized...
research
08/21/2018

Multinomial Models with Linear Inequality Constraints: Overview and Improvements of Computational Methods for Bayesian Inference

Many psychological theories can be operationalized as linear inequality ...
research
05/07/2021

Geometric convergence of elliptical slice sampling

For Bayesian learning, given likelihood function and Gaussian prior, the...
research
04/07/2022

Calibration of a bumble bee foraging model using Approximate Bayesian Computation

1. Challenging calibration of complex models can be approached by using ...
research
01/06/2023

Reversibility of elliptical slice sampling revisited

We discuss the well-definedness of elliptical slice sampling, a Markov c...
research
01/24/2015

Consistency Analysis of Nearest Subspace Classifier

The Nearest subspace classifier (NSS) finds an estimation of the underly...
research
05/05/2023

Dimension-independent spectral gap of polar slice sampling

Polar slice sampling, a Markov chain construction for approximate sampli...

Please sign up or login with your details

Forgot password? Click here to reset