An Extended Cencov-Campbell Characterization of Conditional Information Geometry

07/11/2012
by   Guy Lebanon, et al.
0

We formulate and prove an axiomatic characterization of conditional information geometry, for both the normalized and the nonnormalized cases. This characterization extends the axiomatic derivation of the Fisher geometry by Cencov and Campbell to the cone of positive conditional models, and as a special case to the manifold of conditional distributions. Due to the close connection between the conditional I-divergence and the product Fisher information metric the characterization provides a new axiomatic interpretation of the primal problems underlying logistic regression and AdaBoost.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/25/2015

A Note on the Kullback-Leibler Divergence for the von Mises-Fisher distribution

We present a derivation of the Kullback Leibler (KL)-Divergence (also kn...
research
07/22/2021

One-parameter generalised Fisher information

We introduce the generalised Fisher information or the one-parameter ext...
research
05/27/2013

Some results on a χ-divergence, an extended Fisher information and generalized Cramér-Rao inequalities

We propose a modified χ^β-divergence, give some of its properties, and s...
research
06/12/2020

On Voronoi diagrams and dual Delaunay complexes on the information-geometric Cauchy manifolds

We study the Voronoi diagrams of a finite set of Cauchy distributions an...
research
11/17/2020

Fisher Information of a Family of Generalized Normal Distributions

In this brief note we compute the Fisher information of a family of gene...
research
12/19/2022

An Extension of Fisher's Criterion: Theoretical Results with a Neural Network Realization

Fisher's criterion is a widely used tool in machine learning for feature...
research
03/29/2020

Information geometry for phylogenetic trees

We propose a new space to model phylogenetic trees. It is based on a bio...

Please sign up or login with your details

Forgot password? Click here to reset