Generic construction of scale-invariantly coarse grained memory

06/12/2014
by   Karthik H. Shankar, et al.
0

Encoding temporal information from the recent past as spatially distributed activations is essential in order for the entire recent past to be simultaneously accessible. Any biological or synthetic agent that relies on the past to predict/plan the future, would be endowed with such a spatially distributed temporal memory. Simplistically, we would expect that resource limitations would demand the memory system to store only the most useful information for future prediction. For natural signals in real world which show scale free temporal fluctuations, the predictive information encoded in memory is maximal if the past information is scale invariantly coarse grained. Here we examine the general mechanism to construct a scale invariantly coarse grained memory system. Remarkably, the generic construction is equivalent to encoding the linear combinations of Laplace transform of the past information and their approximated inverses. This reveals a fundamental construction constraint on memory networks that attempt to maximize predictive information storage relevant to the natural world.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/22/2012

Optimally fuzzy temporal memory

Any learner with the ability to predict the future of a structured time-...
research
01/26/2021

Predicting the future with a scale-invariant temporal memory for the past

In recent years it has become clear that the brain maintains a temporal ...
research
02/09/2018

Optimized Bacteria are Environmental Prediction Engines

Experimentalists have observed phenotypic variability in isogenic bacter...
research
12/19/2017

Scale-invariant temporal history (SITH): optimal slicing of the past in an uncertain world

In both the human brain and any general artificial intelligence (AI), a ...
research
04/25/2019

Performance Prediction for Coarse-Grained Locking

A standard design pattern found in many concurrent data structures, such...
research
02/24/2020

Embedded-physics machine learning for coarse-graining and collective variable discovery without data

We present a novel learning framework that consistently embeds underlyin...
research
05/14/2021

Quantum coarse-graining for extreme dimension reduction in modelling stochastic temporal dynamics

Stochastic modelling of complex systems plays an essential, yet often co...

Please sign up or login with your details

Forgot password? Click here to reset