DeepAI AI Chat
Log In Sign Up

Probability of Error for Detecting a Change in a Parameter, Total Variation of the Posterior Distribution, and Bayesian Fisher Information

by   Eric Clarkson, et al.

The van Trees inequality relates the Ensemble Mean Squared Error of an estimator to a Bayesian version of the Fisher Information. The Ziv-Zakai inequality relates the Ensemble Mean Squared Error of an estimator to the Minimum Probability of Error for the task of detecting a change in the parameter. In this work we complete this circle by deriving an inequality that relates this Minimum Probability of Error to the Bayesian version of the Fisher Information. We discuss this result for both scalar and vector parameters. In the process we discover that an important intermediary in the calculation is the Total Variation of the posterior probability distribiution function for the parameter given the data. This total variation is of interest in its own right since it may be easier to compute than the other figures of merit discussed here. Examples are provided to show that the inequality derived here is sharp.


page 1

page 2

page 3

page 4


The Relation Between Bayesian Fisher Information and Shannon Information for Detecting a Change in a Parameter

We derive a connection between performance of estimators the performance...

The randomization by Wishart laws and the Fisher information

Consider the centered Gaussian vector X in ^n with covariance matrix Σ. ...

An improvement of Koksma's inequality and convergence rates for the quasi-Monte Carlo method

When applying the quasi-Monte Carlo (QMC) method of numerical integratio...

Element-wise estimation error of a total variation regularized estimator for change point detection

This work studies the total variation regularized ℓ_2 estimator (fused l...

Logistic regression with total variation regularization

We study logistic regression with total variation penalty on the canonic...

Total Variation Isoperimetric Profiles

Applications in political redistricting demand quantitative measures of ...