The Relation Between Bayesian Fisher Information and Shannon Information for Detecting a Change in a Parameter

01/31/2019
by   Eric Clarkson, et al.
0

We derive a connection between performance of estimators the performance of the ideal observer on related detection tasks. Specifically we show how Shannon Information for the task of detecting a change in a parameter is related to the Fisher Information and the Bayesian Fisher Information. We have previously shown that this Shannon Information is related via an integral transform to the Minimum Probability of Error on the same task. We then outline a circle of relations starting with this Minimum Probability of Error and Ensemble Mean Squared Error via the Ziv-Zakai inequality, then the Ensemble Mean Squared error for an estimator and the Bayesian Fisher Information via the van Trees Inequality, and finally the Bayesian Fisher Information and the Shannon Information for a detection task via the work here.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/31/2019

Probability of Error for Detecting a Change in a Parameter, Total Variation of the Posterior Distribution, and Bayesian Fisher Information

The van Trees inequality relates the Ensemble Mean Squared Error of an e...
research
07/01/2021

How many samples are needed to reliably approximate the best linear estimator for a linear inverse problem?

The linear minimum mean squared error (LMMSE) estimator is the best line...
research
07/10/2018

Understanding VAEs in Fisher-Shannon Plane

In information theory, Fisher information and Shannon information (entro...
research
04/29/2019

Properties of discrete Fisher information: Cramer-Rao-type and log-Sobolev-type inequalities

The Fisher information have connections with the standard deviation and ...
research
05/07/2020

Nonparametric Estimation of the Fisher Information and Its Applications

This paper considers the problem of estimation of the Fisher information...
research
07/16/2020

Information Theoretic Limits of Cardinality Estimation: Fisher Meets Shannon

In this paper we study the intrinsic tradeoff between the space complexi...
research
12/05/2019

Advanced analysis of temporal data using Fisher-Shannon information: theoretical development and application in geosciences

Complex non-linear time series are ubiquitous in geosciences. Quantifyin...

Please sign up or login with your details

Forgot password? Click here to reset