On Enumerating Distributions for Associated Vectors in the Entropy Space

07/23/2018
by   Sultan Alam, et al.
0

This paper focuses on the problem of finding a distribution for an associated entropic vector in the entropy space nearest to a given, possibly non-entropic, target vector for random variables with a constraint on alphabet size. We show the feasibility to find distribution for associated vector via a sequence of perturbations in the probability mass function. Then we present an algorithm for numerically solving the problem together with extensions, applications, and comparison with the known results.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/19/2019

Minimum--Entropy Couplings and their Applications

Given two discrete random variables X and Y, with probability distributi...
research
05/09/2023

Information Spectrum Converse for Minimum Entropy Couplings and Functional Representations

Given two jointly distributed random variables (X,Y), a functional repre...
research
11/01/2018

Entropy versus variance for symmetric log-concave random variables and related problems

We show that the uniform distribution minimises entropy among all symmet...
research
09/15/2011

Reconstruction of sequential data with density models

We introduce the problem of reconstructing a sequence of multidimensiona...
research
09/25/2018

Some Characterizations and Properties of COM-Poisson Random Variables

This paper introduces some new characterizations of COM-Poisson random v...
research
11/12/2016

Entropic Causal Inference

We consider the problem of identifying the causal direction between two ...
research
09/25/2022

Factor analysis for a mixture of continuous and binary random variables

We propose a multivariate probability distribution that models a linear ...

Please sign up or login with your details

Forgot password? Click here to reset