Simulating normalising constants with referenced thermodynamic integration: application to COVID-19 model selection

09/08/2020
by   Iwona Hawryluk, et al.
19

Model selection is a fundamental part of Bayesian statistical inference; a widely used tool in the field of epidemiology. Simple methods such as Akaike Information Criterion are commonly used but they do not incorporate the uncertainty of the model's parameters, which can give misleading choices when comparing models with similar fit to the data. One approach to model selection in a more rigorous way that uses the full posterior distributions of the models is to compute the ratio of the normalising constants (or model evidence), known as Bayes factors. These normalising constants integrate the posterior distribution over all parameters and balance over and under fitting. However, normalising constants often come in the form of intractable, high-dimensional integrals, therefore special probabilistic techniques need to be applied to correctly estimate the Bayes factors. One such method is thermodynamic integration (TI), which can be used to estimate the ratio of two models' evidence by integrating over a continuous path between the two un-normalised densities. In this paper we introduce a variation of the TI method, here referred to as referenced TI, which computes a single model's evidence in an efficient way by using a reference density such as a multivariate normal - where the normalising constant is known. We show that referenced TI, an asymptotically exact Monte Carlo method of calculating the normalising constant of a single model, in practice converges to the correct result much faster than other competing approaches such as the method of power posteriors. We illustrate the implementation of the algorithm on informative 1- and 2-dimensional examples, and apply it to a popular linear regression problem, and use it to select parameters for a model of the COVID-19 epidemic in South Korea.

READ FULL TEXT

page 10

page 26

04/02/2020

Bayesian model selection approach for colored graphical Gaussian models

We consider a class of colored graphical Gaussian models obtained by pla...
06/26/2018

New Estimation Approaches for the Linear Ballistic Accumulator Model

The Linear Ballistic Accumulator (LBA) model of Brown (2008) is used as ...
02/13/2020

Power-Expected-Posterior Priors as Mixtures of g-Priors

One of the main approaches used to construct prior distributions for obj...
02/26/2019

Automated Model Selection with Bayesian Quadrature

We present a novel technique for tailoring Bayesian quadrature (BQ) to m...
04/01/2019

Default Bayesian Model Selection of Constrained Multivariate Normal Linear Models

A default Bayes factor is proposed for evaluating multivariate normal li...
11/11/2014

Bayesian Evidence and Model Selection

In this paper we review the concepts of Bayesian evidence and Bayes fact...
10/13/2017

Bayes factors for partially observed stochastic epidemic models

We consider the problem of model choice for stochastic epidemic models g...

Code Repositories

referenced-TI

Code for the referenced thermodynamic integration (TI) method of calculating model evidence


view repo