Selection of proposal distributions for generalized importance sampling estimators

05/02/2018
by   Vivekananda Roy, et al.
0

The standard importance sampling (IS) method uses samples from a single proposal distribution and assigns weights to them, according to the ratio of the target and proposal pdfs. This naive IS estimator, generally does not work well in multiple targets examples as the weights can take arbitrarily large values making the estimator highly unstable. In such situations, alternative generalized IS estimators involving samples from multiple proposal distributions are preferred. Just like the standard IS, the success of these multiple IS estimators crucially depends on the choice of the proposal distributions. The selection of these proposal distributions is the focus of this article. We propose three methods based on (i) a geometric space filling coverage criterion, (ii) a sequential maximum variance approach, and (iii) a maximum entropy approach. In particular, we describe these methods in the context of Doss's (2010) two-stage IS estimator, although the first two methods are applicable to any multi-proposal IS estimator. Two of the proposed approaches use estimates of asymptotic variances of Geyer's (1994) reverse logistic estimator and Doss's (2010) IS estimators. Thus, we provide consistent spectral variance estimators for these asymptotic variances. We demonstrate the performance of these spectral variance methods for estimating the size parameter of a negative binomial generalized linear model. The proposed methods for selecting proposal densities are illustrated using two detailed examples. The first example is a robust Bayesian binary regression model, where the generalized IS method is used to estimate the link function parameter. The second example involves analysis of count data using the Poisson spatial generalized linear mixed model.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/13/2018

Effective Reparameterized Importance Sampling for Spatial Generalized Linear Mixed Models with Parametric Links

Spatial generalized linear mixed models (SGLMMs) have been popular for a...
research
07/13/2022

BR-SNIS: Bias Reduced Self-Normalized Importance Sampling

Importance Sampling (IS) is a method for approximating expectations unde...
research
05/25/2018

Accurate Computation of Marginal Data Densities Using Variational Bayes

Bayesian model selection and model averaging rely on estimates of margin...
research
08/18/2019

Revisiting the balance heuristic for estimating normalising constants

Multiple importance sampling estimators are widely used for computing in...
research
11/28/2019

Novel Non-Negative Variance Estimator for (Modified) Within-Cluster Resampling

This article proposes a novel variance estimator for within-cluster resa...
research
10/26/2017

Directional Metropolis-Hastings

We propose a new kernel for Metropolis Hastings called Directional Metro...
research
03/02/2017

In Search of an Entity Resolution OASIS: Optimal Asymptotic Sequential Importance Sampling

Entity resolution (ER) presents unique challenges for evaluation methodo...

Please sign up or login with your details

Forgot password? Click here to reset