Simulation-Based Prior Knowledge Elicitation for Parametric Bayesian Models

08/22/2023
by   Florence Bockting, et al.
0

A central characteristic of Bayesian statistics is the ability to consistently incorporate prior knowledge into various modeling processes. In this paper, we focus on translating domain expert knowledge into corresponding prior distributions over model parameters, a process known as prior elicitation. Expert knowledge can manifest itself in diverse formats, including information about raw data, summary statistics, or model parameters. A major challenge for existing elicitation methods is how to effectively utilize all of these different formats in order to formulate prior distributions that align with the expert's expectations, regardless of the model structure. To address these challenges, we develop a simulation-based elicitation method that can learn the hyperparameters of potentially any parametric prior distribution from a wide spectrum of expert knowledge using stochastic gradient descent. We validate the effectiveness and robustness of our elicitation method in four representative case studies covering linear models, generalized linear models, and hierarchical models. Our results support the claim that our method is largely independent of the underlying model structure and adaptable to various elicitation techniques, including quantile-based, moment-based, and histogram-based methods.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/24/2019

A note on locally optimal designs for generalized linear models with restricted support

Optimal designs for generalized linear models require a prior knowledge ...
research
12/01/2021

Prior knowledge elicitation: The past, present, and future

Specification of the prior distribution for a Bayesian model is a centra...
research
10/27/2019

Prior specification via prior predictive matching: Poisson matrix factorization and beyond

Hyperparameter optimization for machine learning models is typically car...
research
02/23/2020

Flexible Prior Elicitation via the Prior Predictive Distribution

The prior distribution for the unknown model parameters plays a crucial ...
research
03/27/2023

Prior Elicitation for Generalised Linear Models and Extensions

A statistical method for the elicitation of priors in Bayesian generalis...
research
07/04/2012

Learning Bayesian Network Parameters with Prior Knowledge about Context-Specific Qualitative Influences

We present a method for learning the parameters of a Bayesian network wi...
research
12/24/2018

Moment Matching Training for Neural Machine Translation: A Preliminary Study

In previous works, neural sequence models have been shown to improve sig...

Please sign up or login with your details

Forgot password? Click here to reset