On Reparameterization Invariant Bayesian Point Estimates and Credible Regions

09/22/2021
by   Aki Vehtari, et al.
0

This paper considers reparameterization invariant Bayesian point estimates and credible regions of model parameters for scientific inference and communication. The effect of intrinsic loss function choice in Bayesian intrinsic estimates and regions is studied with the following findings. A particular intrinsic loss function, using Kullback-Leibler divergence from the full model to the restricted model, has strong connection to a Bayesian predictive criterion, which produces point estimates with the best predictive performance. An alternative intrinsic loss function, using Kullback-Leibler divergence from the restricted model to the full model, produces estimates with interesting frequency properties for at least some commonly used distributions, that is, unbiased minimum variance estimates of the location and scale parameters.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/23/2022

A Jensen-Shannon Divergence Based Loss Function for Bayesian Neural Networks

Kullback-Leibler (KL) divergence is widely used for variational inferenc...
research
04/07/2020

Stability of Gibbs Posteriors from the Wasserstein Loss for Bayesian Full Waveform Inversion

Recently, the Wasserstein loss function has been proven to be effective ...
research
06/07/2018

On Predictive Density Estimation under α-divergence Loss

Based on X ∼ N_d(θ, σ^2_X I_d), we study the efficiency of predictive de...
research
09/09/2019

Fixes to the Ryden McNeil Ammonia Flux Model

We propose two simple fixes to the Ryden and McNeil ammonia flux model. ...
research
11/15/2022

On the Performance of Direct Loss Minimization for Bayesian Neural Networks

Direct Loss Minimization (DLM) has been proposed as a pseudo-Bayesian me...
research
06/30/2022

A Bayesian 'sandwich' for variance estimation and hypothesis testing

Many frequentist methods have large-sample Bayesian analogs, but widely-...

Please sign up or login with your details

Forgot password? Click here to reset