Entropy of Sharp Restart

07/05/2022
by   Iddo Eliazar, et al.
0

Restart has the potential of expediting or impeding the completion times of general random processes. Consequently, the issue of mean-performance takes center stage: quantifying how the application of restart on a process of interest impacts its completion-time's mean. Going beyond the mean, little is known on how restart affects stochasticity measures of the completion time. This paper is the first in a duo of studies that address this knowledge gap via: a comprehensive analysis that quantifies how sharp restart – a keystone restart protocol – impacts the completion-time's Boltzmann-Gibbs-Shannon entropy. The analysis establishes closed-form results for sharp restart with general timers, with fast timers (high-frequency resetting), and with slow timers (low-frequency resetting). These results share a common structure: comparing the completion-time's hazard rate to a flat benchmark – the constant hazard rate of an exponential distribution whose entropy is equal to the completion-time's entropy. In addition, using an information-geometric approach based on Kullback-Leibler distances, the analysis establishes results that determine the very existence of timers with which the application of sharp restart decreases or increases the completion-time's entropy. Our work sheds first light on the intricate interplay between restart and randomness – as gauged by the Boltzmann-Gibbs-Shannon entropy.

READ FULL TEXT

page 5

page 6

page 10

page 11

page 12

page 24

page 25

page 26

research
12/29/2011

Multi-q Analysis of Image Patterns

This paper studies the use of the Tsallis Entropy versus the classic Bol...
research
06/23/2021

An entropic method for discrete systems with Gibbs entropy

We consider general systems of ordinary differential equations with mono...
research
02/25/2019

Ternary Representation of Stochastic Change and the Origin of Entropy and Its Fluctuations

A change in a stochastic system has three representations: Probabilistic...
research
10/07/2021

Physics-inspired analysis of the two-class income distribution in the USA in 1983-2018

The first part of this paper is a brief survey of the approaches to econ...
research
08/14/2023

The algorithmic second law of thermodynamics

Gács' coarse-grained algorithmic entropy leverages universal computation...
research
06/29/2023

Tokenization and the Noiseless Channel

Subword tokenization is a key part of many NLP pipelines. However, littl...
research
01/10/2014

Satellite image classification and segmentation using non-additive entropy

Here we compare the Boltzmann-Gibbs-Shannon (standard) with the Tsallis ...

Please sign up or login with your details

Forgot password? Click here to reset