Learning Approximately Objective Priors

04/04/2017
by   Eric Nalisnick, et al.
0

Informative Bayesian priors are often difficult to elicit, and when this is the case, modelers usually turn to noninformative or objective priors. However, objective priors such as the Jeffreys and reference priors are not tractable to derive for many models of interest. We address this issue by proposing techniques for learning reference prior approximations: we select a parametric family and optimize a black-box lower bound on the reference prior objective to find the member of the family that serves as a good approximation. We experimentally demonstrate the method's effectiveness by recovering Jeffreys priors and learning the Variational Autoencoder's reference prior.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/01/2022

Deep Reference Priors: What is the best way to pretrain a model?

What is the best way to exploit extra data – be it unlabeled data from t...
research
07/18/2023

Deterministic Objective Bayesian Analysis for Spatial Models

Berger et al. (2001) and Ren et al. (2012) derived noninformative priors...
research
02/03/2023

Optimality of Thompson Sampling with Noninformative Priors for Pareto Bandits

In the stochastic multi-armed bandit problem, a randomized probability m...
research
07/20/2018

Prior Convictions: Black-Box Adversarial Attacks with Bandits and Priors

We introduce a framework that unifies the existing work on black-box adv...
research
06/18/2020

Predictive Complexity Priors

Specifying a Bayesian prior is notoriously difficult for complex models ...
research
02/06/2023

A multidimensional objective prior distribution from a scoring rule

The construction of objective priors is, at best, challenging for multid...
research
05/09/2018

Three tree priors and five datasets: A study of the effect of tree priors in Indo-European phylogenetics

The age of the root of the Indo-European language family has received mu...

Please sign up or login with your details

Forgot password? Click here to reset