Simultaneous Estimation of Non-Gaussian Components and their Correlation Structure

by   Hiroaki Sasaki, et al.

The statistical dependencies which independent component analysis (ICA) cannot remove often provide rich information beyond the linear independent components. It would thus be very useful to estimate the dependency structure from data. While such models have been proposed, they usually concentrated on higher-order correlations such as energy (square) correlations. Yet, linear correlations are a most fundamental and informative form of dependency in many real data sets. Linear correlations are usually completely removed by ICA and related methods, so they can only be analyzed by developing new methods which explicitly allow for linearly correlated components. In this paper, we propose a probabilistic model of linear non-Gaussian components which are allowed to have both linear and energy correlations. The precision matrix of the linear components is assumed to be randomly generated by a higher-order process and explicitly parametrized by a parameter matrix. The estimation of the parameter matrix is shown to be particularly simple because using score matching, the objective function is a quadratic form. Using simulations with artificial data, we demonstrate that the proposed method improves identifiability of non-Gaussian components by simultaneously learning their correlation structure. Applications on simulated complex cells with natural image input, as well as spectrograms of natural audio data show that the method finds new kinds of dependencies between the components.


page 13

page 14

page 17

page 19

page 20


Visualizing Topographic Independent Component Analysis with Movies

Independent component analysis (ICA) has often been used as a tool to mo...

Optimization and Testing in Linear Non-Gaussian Component Analysis

Independent component analysis (ICA) decomposes multivariate data into m...

Estimation of Structural Causal Model via Sparsely Mixing Independent Component Analysis

We consider the problem of inferring the causal structure from observati...

Determining the Dimension and Structure of the Subspace Correlated Across Multiple Data Sets

Detecting the components common or correlated across multiple data sets ...

A study of problems with multiple interdependent components - Part I

Recognising that real-world optimisation problems have multiple interdep...

Identification and estimation of Structural VARMA models using higher order dynamics

We use information from higher order moments to achieve identification o...

Non-Independent Components Analysis

A seminal result in the ICA literature states that for AY = ε, if the co...

Please sign up or login with your details

Forgot password? Click here to reset