Bayesian automated posterior repartitioning for nested sampling

08/13/2019
by   Xi Chen, et al.
0

Priors in Bayesian analyses often encode informative domain knowledge that can be useful in making the inference process more efficient. Occasionally, however, priors may be unrepresentative of the parameter values for a given dataset, which can result in inefficient parameter space exploration, or even incorrect inferences, particularly for nested sampling (NS) algorithms. Simply broadening the prior in such cases may be inappropriate or impossible in some applications. Hence a previous solution of this problem, known as posterior repartitioning (PR), redefines the prior and likelihood while keeping their product fixed, so that the posterior inferences and evidence estimates remain unchanged, but the efficiency of the NS process is significantly increased. In its most practical form, PR raises the prior to some power β, which is introduced as an auxiliary variable that must be determined on a case-by-case basis, usually by lowering β from unity according to some pre-defined `annealing schedule' until the resulting inferences converge to a consistent solution. We present here an alternative Bayesian `automated PR' method, in which β is instead treated as a hyperparameter that is inferred from the data alongside the original parameters of the problem, and then marginalised over to obtain the final inference. We show through numerical examples that this approach provides a robust and efficient `hands-off' solution to addressing the issue of unrepresentative priors in Bayesian inference using NS. Moreover, we show that for problems with representative priors the method has a negligible computational overhead relative to standard nesting sampling, which suggests that it should be used in as a matter of course in all NS analyses.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/16/2018

Improving the efficiency and robustness of nested sampling using posterior repartitioning

In real-world Bayesian inference applications, prior assumptions regardi...
research
08/11/2020

Bayesian selective inference: sampling models and non-informative priors

We discuss Bayesian inference for parameters selected using the data. We...
research
06/02/2016

Post-Inference Prior Swapping

While Bayesian methods are praised for their ability to incorporate usef...
research
05/28/2020

Data Analysis Recipes: Products of multivariate Gaussians in Bayesian inferences

A product of two Gaussians (or normal distributions) is another Gaussian...
research
09/12/2018

Bayesian sparse reconstruction: a brute-force approach to astronomical imaging and machine learning

We present a principled Bayesian framework for signal reconstruction, in...
research
01/25/2019

Bayesian surrogate learning in dynamic simulator-based regression problems

The estimation of unknown values of parameters (or hidden variables, con...
research
07/19/2023

Regularizing threshold priors with sparse response patterns in Bayesian factor analysis with categorical indicators

Using instruments comprising ordered responses to items are ubiquitous f...

Please sign up or login with your details

Forgot password? Click here to reset