Faster independent component analysis by preconditioning with Hessian approximations

06/25/2017
by   Pierre Ablin, et al.
0

Independent Component Analysis (ICA) is a technique for unsupervised exploration of multi-channel data that is widely used in observational sciences. In its classic form, ICA relies on modeling the data as linear mixtures of non-Gaussian independent sources. The maximization of the corresponding likelihood is a challenging problem if it has to be completed quickly and accurately on large sets of real data. We introduce the Preconditioned ICA for Real Data (Picard) algorithm, which is a relative L-BFGS algorithm preconditioned with sparse Hessian approximations. Extensive numerical comparisons to several algorithms of the same class demonstrate the superior performance of the proposed technique, especially on real data, for which the ICA model does not necessarily hold.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/29/2017

Faster ICA under orthogonal constraint

Independent Component Analysis (ICA) is a technique for unsupervised exp...
research
12/12/2021

Boosting Independent Component Analysis

Independent component analysis is intended to recover the unknown compon...
research
06/25/2018

Accelerating likelihood optimization for ICA on real signals

We study optimization methods for solving the maximum likelihood formula...
research
09/07/2020

Estimation of Structural Causal Model via Sparsely Mixing Independent Component Analysis

We consider the problem of inferring the causal structure from observati...
research
04/11/2014

A Tutorial on Independent Component Analysis

Independent component analysis (ICA) has become a standard data analysis...
research
10/22/2016

Independent Component Analysis by Entropy Maximization with Kernels

Independent component analysis (ICA) is the most popular method for blin...
research
11/30/2021

Second-order Approximation of Minimum Discrimination Information in Independent Component Analysis

Independent Component Analysis (ICA) is intended to recover the mutually...

Please sign up or login with your details

Forgot password? Click here to reset