Ab initio Algorithmic Causal Deconvolution of Intertwined Programs and Networks by Generative Mechanism

02/18/2018
by   Hector Zenil, et al.
0

To extract and learn representations leading to generative mechanisms from data, especially without making arbitrary decisions and biased assumptions, is a central challenge in most areas of scientific research particularly in connection to current major limitations of influential topics and methods of machine and deep learning as they have often lost sight of the model component. Complex data is usually produced by interacting sources with different mechanisms. Here we introduce a parameter-free model-based approach, based upon the seminal concept of Algorithmic Probability, that decomposes an observation and signal into its most likely algorithmic generative mechanisms. Our methods use a causal calculus to infer model representations. We demonstrate the method ability to distinguish interacting mechanisms and deconvolve them, regardless of whether the objects produce strings, space-time evolution diagrams, images or networks. We numerically test and evaluate our method and find that it can disentangle observations from discrete dynamic systems, random and complex networks. We think that these causal inference techniques can contribute as key pieces of information for estimations of probability distributions complementing other more statistical-oriented techniques that otherwise lack model inference capabilities.

READ FULL TEXT

page 11

page 21

research
03/28/2023

Optimal Spatial Deconvolution and Message Reconstruction from a Large Generative Model of Models

We introduce a general-purpose univariate signal deconvolution method ba...
research
05/10/2018

Bivariate Causal Discovery and its Applications to Gene Expression and Imaging Data Analysis

The mainstream of research in genetics, epigenetics and imaging data ana...
research
04/23/2008

Causal inference using the algorithmic Markov condition

Inferring the causal structure that links n observables is usually based...
research
09/23/2018

Causal Inference and Mechanism Clustering of a Mixture of Additive Noise Models

The inference of the causal relationship between a pair of observed vari...
research
12/04/2017

Learning Independent Causal Mechanisms

Independent causal mechanisms are a central concept in the study of caus...
research
04/01/2020

A theory of independent mechanisms for extrapolation in generative models

Deep generative models reproduce complex empirical data but cannot extra...
research
06/05/2023

Learning Causal Mechanisms through Orthogonal Neural Networks

A fundamental feature of human intelligence is the ability to infer high...

Please sign up or login with your details

Forgot password? Click here to reset