Innovation Representation of Stochastic Processes with Application to Causal Inference

11/25/2018
by   Amichai Painsky, et al.
0

Typically, real-world stochastic processes are not easy to analyze. In this work we study the representation of any stochastic process as a memoryless innovation process triggering a dynamic system. We show that such a representation is always feasible for innovation processes taking values over a continuous set. However, the problem becomes more challenging when the alphabet size of the innovation is finite. In this case, we introduce both lossless and lossy frameworks, and provide closed-form solutions and practical algorithmic methods. In addition, we discuss the properties and uniqueness of our suggested approach. Finally, we show that the innovation representation problem has many applications. We focus our attention to Entropic Causal Inference, which has recently demonstrated promising performance, compared to alternative methods.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/05/2023

Interacting Innovation processes: case studies from Reddit and Gutenberg

The existing literature about innovation processes focuses on a single p...
research
06/08/2023

Innovation processes for inference

In this letter, we introduce a new approach to quantify the closeness of...
research
11/06/2021

The How and Why of Bayesian Nonparametric Causal Inference

Spurred on by recent successes in causal inference competitions, Bayesia...
research
05/10/2020

Maximal Algorithmic Caliber and Algorithmic Causal Network Inference: General Principles of Real-World General Intelligence?

Ideas and formalisms from far-from-equilibrium thermodynamics are ported...
research
06/23/2021

Closed-Form, Provable, and Robust PCA via Leverage Statistics and Innovation Search

The idea of Innovation Search, which was initially proposed for data clu...
research
04/18/2020

Integer-valued autoregressive process with flexible marginal and innovation distributions

INteger Auto-Regressive (INAR) processes are usually defined by specifyi...
research
11/30/2020

Calibration for Multivariate Lévy-Driven Ornstein-Uhlenbeck Processes with Applications to Weak Subordination

Consider a multivariate Lévy-driven Ornstein-Uhlenbeck process where the...

Please sign up or login with your details

Forgot password? Click here to reset