Information sensitivity functions to assess parameter information gain and identifiability of dynamical systems

11/21/2017
by   Sanjay Pant, et al.
0

A new class of functions, called the `Information sensitivity functions' (ISFs), which quantify the information gain about the parameters through the measurements/observables of a dynamical system are presented. These functions can be easily computed through classical sensitivity functions alone and are based on Bayesian and information-theoretic approaches. While marginal information gain is quantified by decrease in differential entropy, correlations between arbitrary sets of parameters are assessed through mutual information. For individual parameters these information gains are also presented as marginal posterior variances, and, to assess the effect of correlations, as conditional variances when other parameters are given. The easy to interpret ISFs can be used to a) identify time-intervals or regions in dynamical system behaviour where information about the parameters is concentrated; b) assess the effect of measurement noise on the information gain for the parameters; c) assess whether sufficient information in an experimental protocol (input, measurements, and their frequency) is available to identify the parameters; d) assess correlation in the posterior distribution of the parameters to identify the sets of parameters that are likely to be indistinguishable; and e) assess identifiability problems for particular sets of parameters.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/23/2022

Hyper-differential sensitivity analysis in the context of Bayesian inference applied to ice-sheet problems

Inverse problems constrained by partial differential equations (PDEs) pl...
research
08/01/2018

Conditional Decoupling of Quantum Information

Insights from quantum information theory show that correlation measures ...
research
06/03/2021

MINIMALIST: Mutual INformatIon Maximization for Amortized Likelihood Inference from Sampled Trajectories

Simulation-based inference enables learning the parameters of a model ev...
research
01/16/2013

Making Sensitivity Analysis Computationally Efficient

To investigate the robustness of the output probabilities of a Bayesian ...
research
08/11/2017

A probabilistic scheme for joint parameter estimation and state prediction in complex dynamical systems

Many problems in the geophysical sciences demand the ability to calibrat...
research
08/14/2018

Analyzing Inverse Problems with Invertible Neural Networks

In many tasks, in particular in natural science, the goal is to determin...
research
03/16/2021

Determining the maximum information gain and optimising experimental design in neutron reflectometry using the Fisher information

An approach based on the Fisher information (FI) is developed to quantif...

Please sign up or login with your details

Forgot password? Click here to reset