Bayesian model selection for multilevel models using marginal likelihoods

07/05/2022
by   Tom Edinburgh, et al.
0

Multilevel linear models allow flexible statistical modelling of complex data with different levels of stratification. Identifying the most appropriate model from the large set of possible candidates is a challenging problem. In the Bayesian setting, the standard approach is a comparison of models using the model evidence or the Bayes factor. Explicit expressions for these quantities are available for simple linear models, but in most cases, direct computation is impossible. In practice, Markov Chain Monte Carlo approaches are widely used, such as sequential Monte Carlo, but it is not always clear how well such techniques perform. We present a method for estimation of the log model evidence, by an intermediate marginalisation over non-variance parameters. This reduces the dimensionality of the Monte Carlo sampling algorithm, which in turn yields more consistent estimates. The aim of this paper is to show how this framework fits together and works in practice, particularly on data with hierarchical structure. We illustrate this method on a popular multilevel dataset containing levels of radon in homes in the US state of Minnesota.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/23/2019

Multilevel Monte Carlo estimation of log marginal likelihood

In this short note we provide an unbiased multilevel Monte Carlo estimat...
research
04/25/2020

A Bayesian machine scientist to aid in the solution of challenging scientific problems

Closed-form, interpretable mathematical models have been instrumental fo...
research
07/26/2022

A Bayesian hierarchical framework for emulating a complex crop yield simulator

Emulation of complex computer simulations have become an effective tool ...
research
01/22/2020

A numerically stable algorithm for integrating Bayesian models using Markov melding

When statistical analyses consider multiple data sources, Markov melding...
research
09/25/2014

Identification of jump Markov linear models using particle filters

Jump Markov linear models consists of a finite number of linear state sp...
research
05/14/2021

Bayesian inference-driven model parameterization and model selection for 2CLJQ fluid models

A high level of physical detail in a molecular model improves its abilit...
research
03/20/2013

Reasoning under Uncertainty: Some Monte Carlo Results

A series of monte carlo studies were performed to compare the behavior o...

Please sign up or login with your details

Forgot password? Click here to reset