Finite-State Mutual Dimension

09/29/2021
by   Adam Case, et al.
0

In 2004, Dai, Lathrop, Lutz, and Mayordomo defined and investigated the finite-state dimension (a finite-state version of algorithmic dimension) of a sequence S ∈Σ^∞ and, in 2018, Case and Lutz defined and investigated the mutual (algorithmic) dimension between two sequences S ∈Σ^∞ and T ∈Σ^∞. In this paper, we propose a definition for the lower and upper finite-state mutual dimensions mdim_FS(S:T) and Mdim_FS(S:T) between two sequences S ∈Σ^∞ and T ∈Σ^∞ over an alphabet Σ. Intuitively, the finite-state dimension of a sequence S ∈Σ^∞ represents the density of finite-state information contained within S, while the finite-state mutual dimension between two sequences S ∈Σ^∞ and T ∈Σ^∞ represents the density of finite-state information shared by S and T. Thus “finite-state mutual dimension” can be viewed as a “finite-state” version of mutual dimension and as a “mutual” version of finite-state dimension. The main results of this investigation are as follows. First, we show that finite-state mutual dimension, defined using information-lossless finite-state compressors, has all of the properties expected of a measure of mutual information. Next, we prove that finite-state mutual dimension may be characterized in terms of block mutual information rates. Finally, we provide necessary and sufficient conditions for two normal sequences to achieve mdim_FS(S:T) = Mdim_FS(S:T) = 0.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/11/2023

Finite-State Relative Dimension, dimensions of A. P. subsequences and a Finite-State van Lambalgen's theorem

Finite-state dimension (Dai, Lathrop, Lutz, and Mayordomo (2004)) quanti...
research
11/07/2021

A Weyl Criterion for Finite-State Dimension

Finite-state dimension, introduced early in this century as a finite-sta...
research
06/29/2019

Kolmogorov's Algorithmic Mutual Information Is Equivalent to Bayes' Law

Given two events A and B, Bayes' law is based on the argument that the p...
research
06/17/2022

k-Sliced Mutual Information: A Quantitative Study of Scalability with Dimension

Sliced mutual information (SMI) is defined as an average of mutual infor...
research
02/19/2016

A Mutual Contamination Analysis of Mixed Membership and Partial Label Models

Many machine learning problems can be characterized by mutual contaminat...
research
08/12/2022

Real numbers equally compressible in every base

Finite-state compressibility, or equivalently, finite-state dimension, q...
research
10/30/2019

Asymptotic Divergences and Strong Dichotomy

The Schnorr-Stimm dichotomy theorem concerns finite-state gamblers that ...

Please sign up or login with your details

Forgot password? Click here to reset