On some interrelations of generalized q-entropies and a generalized Fisher information, including a Cramér-Rao inequality

05/27/2013
by   Jean-François Bercher, et al.
0

In this communication, we describe some interrelations between generalized q-entropies and a generalized version of Fisher information. In information theory, the de Bruijn identity links the Fisher information and the derivative of the entropy. We show that this identity can be extended to generalized versions of entropy and Fisher information. More precisely, a generalized Fisher information naturally pops up in the expression of the derivative of the Tsallis entropy. This generalized Fisher information also appears as a special case of a generalized Fisher information for estimation problems. Indeed, we derive here a new Cramér-Rao inequality for the estimation of a parameter, which involves a generalized form of Fisher information. This generalized Fisher information reduces to the standard Fisher information as a particular case. In the case of a translation parameter, the general Cramér-Rao inequality leads to an inequality for distributions which is saturated by generalized q-Gaussian distributions. These generalized q-Gaussians are important in several areas of physics and mathematics. They are known to maximize the q-entropies subject to a moment constraint. The Cramér-Rao inequality shows that the generalized q-Gaussians also minimize the generalized Fisher information among distributions with a fixed moment. Similarly, the generalized q-Gaussians also minimize the generalized Fisher information among distributions with a given q-entropy.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/27/2013

Some results on a χ-divergence, an extended Fisher information and generalized Cramér-Rao inequalities

We propose a modified χ^β-divergence, give some of its properties, and s...
research
07/22/2021

One-parameter generalised Fisher information

We introduce the generalised Fisher information or the one-parameter ext...
research
11/17/2020

Fisher Information of a Family of Generalized Normal Distributions

In this brief note we compute the Fisher information of a family of gene...
research
04/29/2019

Properties of discrete Fisher information: Cramer-Rao-type and log-Sobolev-type inequalities

The Fisher information have connections with the standard deviation and ...
research
10/21/2020

The entropy based goodness of fit tests for generalized von Mises-Fisher distributions and beyond

We introduce some new classes of unimodal rotational invariant direction...
research
07/06/2022

Formalising Fisher's Inequality: Formal Linear Algebraic Proof Techniques in Combinatorics

The formalisation of mathematics is continuing rapidly, however combinat...
research
07/29/2019

Diffusion Hypercontractivity via Generalized Density Manifold

We prove a one-parameter family of diffusion hypercontractivity and pres...

Please sign up or login with your details

Forgot password? Click here to reset