On Triangular Inequality of the Discounted Least Information Theory of Entropy (DLITE)

10/14/2022
by   Kashti S. Umare, et al.
0

The Discounted Least Information Theory of Entropy (DLITE) is a new information measure that quantifies the amount of entropic difference between two probability distributions. It manifests multiple critical properties both as an information-theoretic quantity and as metric distance. In the report, we provide a proof of the triangular inequality of DLITE's cube root (√(DL)), an important property of a metric, along with alternative proofs for two additional properties.

READ FULL TEXT

page 1

page 2

page 3

research
05/21/2020

Chang's lemma via Pinsker's inequality

Extending the idea in [Impagliazzo, R., Moore, C. and Russell, A., An en...
research
05/28/2021

Perturbation Theory for the Information Bottleneck

Extracting relevant information from data is crucial for all forms of le...
research
01/15/2021

Is the Chen-Sbert Divergence a Metric?

Recently, Chen and Sbert proposed a general divergence measure. This rep...
research
05/25/2022

Rethinking Fano's Inequality in Ensemble Learning

We propose a fundamental theory on ensemble learning that evaluates a gi...
research
02/11/2020

Generalized Bayesian Cramér-Rao Inequality via Information Geometry of Relative α-Entropy

The relative α-entropy is the Rényi analog of relative entropy and arise...
research
06/11/2023

The capacity of quiver representations and the Anantharam-Jog-Nair inequality

The Anantharam-Jog-Nair inequality [AJN22] in Information Theory provide...
research
11/13/2019

Proofs of conservation inequalities for Levin's notion of mutual information of 1974

In this paper we consider Levin's notion of mutual information in infini...

Please sign up or login with your details

Forgot password? Click here to reset