Amortized Bayesian model comparison with evidential deep learning

04/22/2020
by   Stefan T. Radev, et al.
0

Comparing competing mathematical models of complex natural processes is a shared goal among many branches of science. The Bayesian probabilistic framework offers a principled way to perform model comparison and extract useful metrics for guiding decisions. However, many interesting models are intractable with standard Bayesian methods, as they lack a closed-form likelihood function or the likelihood is computationally too expensive to evaluate. With this work, we propose a novel method for performing Bayesian model comparison using specialized deep learning architectures. Our method is purely simulation-based and circumvents the step of explicitly fitting all alternative models under consideration to each observed dataset. Moreover, it involves no hand-crafted summary statistics of the data and is designed to amortize the cost of simulation over multiple models and observable datasets. This makes the method applicable in scenarios where model fit needs to be assessed for a large number of datasets, so that per-dataset inference is practically infeasible. Finally, we propose a novel way to measure epistemic uncertainty in model comparison problems. We argue that this measure of epistemic uncertainty provides a unique proxy to quantify absolute evidence even in a framework which assumes that the true data-generating model is within a finite set of candidate models.

READ FULL TEXT
research
03/13/2020

BayesFlow: Learning complex stochastic models with invertible neural networks

Estimating the parameters of mathematical models is a common problem in ...
research
03/15/2022

Model Comparison in Approximate Bayesian Computation

A common problem in natural sciences is the comparison of competing mode...
research
01/27/2023

A Deep Learning Method for Comparing Bayesian Hierarchical Models

Bayesian model comparison (BMC) offers a principled approach for assessi...
research
10/13/2022

Meta-Uncertainty in Bayesian Model Comparison

Bayesian model comparison (BMC) offers a principled probabilistic approa...
research
09/14/2018

Optimal Bayesian design for model discrimination via classification

Performing optimal Bayesian design for discriminating between competing ...
research
07/04/2022

Look beyond labels: Incorporating functional summary information in Bayesian neural networks

Bayesian deep learning offers a principled approach to train neural netw...

Please sign up or login with your details

Forgot password? Click here to reset