DeepAI AI Chat
Log In Sign Up

A Pseudo-Euclidean Iteration for Optimal Recovery in Noisy ICA

by   James Voss, et al.
The Ohio State University

Independent Component Analysis (ICA) is a popular model for blind signal separation. The ICA model assumes that a number of independent source signals are linearly mixed to form the observed signals. We propose a new algorithm, PEGI (for pseudo-Euclidean Gradient Iteration), for provable model recovery for ICA with Gaussian noise. The main technical innovation of the algorithm is to use a fixed point iteration in a pseudo-Euclidean (indefinite "inner product") space. The use of this indefinite "inner product" resolves technical issues common to several existing algorithms for noisy ICA. This leads to an algorithm which is conceptually simple, efficient and accurate in testing. Our second contribution is combining PEGI with the analysis of objectives for optimal recovery in the noisy ICA model. It has been observed that the direct approach of demixing with the inverse of the mixing matrix is suboptimal for signal recovery in terms of the natural Signal to Interference plus Noise Ratio (SINR) criterion. There have been several partial solutions proposed in the ICA literature. It turns out that any solution to the mixing matrix reconstruction problem can be used to construct an SINR-optimal ICA demixing, despite the fact that SINR itself cannot be computed from data. That allows us to obtain a practical and provably SINR-optimal recovery method for ICA with arbitrary Gaussian noise.


page 1

page 2

page 3

page 4


Blind Signal Separation in the Presence of Gaussian Noise

A prototypical blind signal separation problem is the so-called cocktail...

Partial Recovery for Top-k Ranking: Optimality of MLE and Sub-Optimality of Spectral Method

Given partially observed pairwise comparison data generated by the Bradl...

The Dantzig selector: Recovery of Signal via ℓ_1-αℓ_2 Minimization

In the paper, we proposed the Dantzig selector based on the ℓ_1-αℓ_2 (0<...

Orthogonal Cocktail BPSK: Exceeding Shannon Capacity of QPSK Input

Shannon channel capacity of an additive white Gaussian noise channel is ...

Multichannel sparse recovery of complex-valued signals using Huber's criterion

In this paper, we generalize Huber's criterion to multichannel sparse re...

Fast Independent Vector Extraction by Iterative SINR Maximization

We propose fast independent vector extraction (FIVE), a new algorithm th...