DeepAI
Log In Sign Up

Simultaneous Estimation of Non-Gaussian Components and their Correlation Structure

06/18/2015
by   Hiroaki Sasaki, et al.
0

The statistical dependencies which independent component analysis (ICA) cannot remove often provide rich information beyond the linear independent components. It would thus be very useful to estimate the dependency structure from data. While such models have been proposed, they usually concentrated on higher-order correlations such as energy (square) correlations. Yet, linear correlations are a most fundamental and informative form of dependency in many real data sets. Linear correlations are usually completely removed by ICA and related methods, so they can only be analyzed by developing new methods which explicitly allow for linearly correlated components. In this paper, we propose a probabilistic model of linear non-Gaussian components which are allowed to have both linear and energy correlations. The precision matrix of the linear components is assumed to be randomly generated by a higher-order process and explicitly parametrized by a parameter matrix. The estimation of the parameter matrix is shown to be particularly simple because using score matching, the objective function is a quadratic form. Using simulations with artificial data, we demonstrate that the proposed method improves identifiability of non-Gaussian components by simultaneously learning their correlation structure. Applications on simulated complex cells with natural image input, as well as spectrograms of natural audio data show that the method finds new kinds of dependencies between the components.

READ FULL TEXT

page 13

page 14

page 17

page 19

page 20

01/24/2019

Visualizing Topographic Independent Component Analysis with Movies

Independent component analysis (ICA) has often been used as a tool to mo...
12/23/2017

Optimization and Testing in Linear Non-Gaussian Component Analysis

Independent component analysis (ICA) decomposes multivariate data into m...
01/31/2019

Determining the Dimension and Structure of the Subspace Correlated Across Multiple Data Sets

Detecting the components common or correlated across multiple data sets ...
09/07/2020

Estimation of Structural Causal Model via Sparsely Mixing Independent Component Analysis

We consider the problem of inferring the causal structure from observati...
03/01/2019

A study of problems with multiple interdependent components - Part I

Recognising that real-world optimisation problems have multiple interdep...
04/02/2018

Sparse Gaussian ICA

Independent component analysis (ICA) is a cornerstone of modern data ana...
06/28/2022

Non-Independent Components Analysis

A seminal result in the ICA literature states that for AY = ε, if the co...