research
∙
07/24/2023
Corrections of Zipf's and Heaps' Laws Derived from Hapax Rate Models
The article introduces corrections to Zipf's and Heaps' laws based on sy...
share
research
∙
06/26/2023
Recurrence and repetition times in the case of a stretched exponential growth
By an analogy to the duality between the recurrence time and the longest...
research
∙
02/17/2023
A Simplistic Model of Neural Scaling Laws: Multiperiodic Santa Fe Processes
It was observed that large language models exhibit a power-law decay of ...
research
∙
11/02/2022
There Are Fewer Facts Than Words: Communication With A Growing Complexity
We present an impossibility result, called a theorem about facts and wor...
research
∙
09/27/2022
Local Grammar-Based Coding Revisited
We revisit the problem of minimal local grammar-based coding. In this se...
research
∙
09/24/2022
Universal Densities Exist for Every Finite Reference Measure
As it is known, universal codes, which estimate the entropy rate consist...
research
∙
11/25/2020
Bounds for Algorithmic Mutual Information and a Unifilar Order Estimator
Inspired by Hilberg's hypothesis, which states that mutual information b...
research
∙
05/07/2020
Universal Coding and Prediction on Martin-Löf Random Points
We perform an effectivization of classical results concerning universal ...
research
∙
03/10/2020
On a Class of Markov Order Estimators Based on PPM and Other Universal Codes
We investigate a class of estimators of the Markov order for stationary ...
research
∙
06/14/2017