Efficient identification of informative features in simulation-based inference

10/21/2022
by   Jonas Beck, et al.
0

Simulation-based Bayesian inference (SBI) can be used to estimate the parameters of complex mechanistic models given observed model outputs without requiring access to explicit likelihood evaluations. A prime example for the application of SBI in neuroscience involves estimating the parameters governing the response dynamics of Hodgkin-Huxley (HH) models from electrophysiological measurements, by inferring a posterior over the parameters that is consistent with a set of observations. To this end, many SBI methods employ a set of summary statistics or scientifically interpretable features to estimate a surrogate likelihood or posterior. However, currently, there is no way to identify how much each summary statistic or feature contributes to reducing posterior uncertainty. To address this challenge, one could simply compare the posteriors with and without a given feature included in the inference process. However, for large or nested feature sets, this would necessitate repeatedly estimating the posterior, which is computationally expensive or even prohibitive. Here, we provide a more efficient approach based on the SBI method neural likelihood estimation (NLE): We show that one can marginalize the trained surrogate likelihood post-hoc before inferring the posterior to assess the contribution of a feature. We demonstrate the usefulness of our method by identifying the most important features for inferring parameters of an example HH neuron model. Beyond neuroscience, our method is generally applicable to SBI workflows that rely on data features for inference used in other scientific fields.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/17/2023

JANA: Jointly Amortized Neural Approximation of Complex Bayesian Models

This work proposes ”jointly amortized neural approximation” (JANA) of in...
research
02/12/2021

Leveraging Global Parameters for Flow-based Neural Posterior Estimation

Inferring the parameters of a stochastic model based on experimental obs...
research
06/17/2021

Hierarchical surrogate-based Approximate Bayesian Computation for an electric motor test bench

Inferring parameter distributions of complex industrial systems from noi...
research
03/13/2020

BayesFlow: Learning complex stochastic models with invertible neural networks

Estimating the parameters of mathematical models is a common problem in ...
research
05/24/2023

Generalized Bayesian Inference for Scientific Simulators via Amortized Cost Estimation

Simulation-based inference (SBI) enables amortized Bayesian inference fo...
research
05/24/2023

Simultaneous identification of models and parameters of scientific simulators

Many scientific models are composed of multiple discrete components, and...
research
07/19/2019

Adaptive sampling-based quadrature rules for efficient Bayesian prediction

A novel method is proposed to infer Bayesian predictions of computationa...

Please sign up or login with your details

Forgot password? Click here to reset