A Pseudo-Euclidean Iteration for Optimal Recovery in Noisy ICA

02/13/2015
by   James Voss, et al.
0

Independent Component Analysis (ICA) is a popular model for blind signal separation. The ICA model assumes that a number of independent source signals are linearly mixed to form the observed signals. We propose a new algorithm, PEGI (for pseudo-Euclidean Gradient Iteration), for provable model recovery for ICA with Gaussian noise. The main technical innovation of the algorithm is to use a fixed point iteration in a pseudo-Euclidean (indefinite "inner product") space. The use of this indefinite "inner product" resolves technical issues common to several existing algorithms for noisy ICA. This leads to an algorithm which is conceptually simple, efficient and accurate in testing. Our second contribution is combining PEGI with the analysis of objectives for optimal recovery in the noisy ICA model. It has been observed that the direct approach of demixing with the inverse of the mixing matrix is suboptimal for signal recovery in terms of the natural Signal to Interference plus Noise Ratio (SINR) criterion. There have been several partial solutions proposed in the ICA literature. It turns out that any solution to the mixing matrix reconstruction problem can be used to construct an SINR-optimal ICA demixing, despite the fact that SINR itself cannot be computed from data. That allows us to obtain a practical and provably SINR-optimal recovery method for ICA with arbitrary Gaussian noise.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/07/2012

Blind Signal Separation in the Presence of Gaussian Noise

A prototypical blind signal separation problem is the so-called cocktail...
research
07/20/2019

Cramér-Rao Bounds for Complex-Valued Independent Component Extraction: Determined and Piecewise Determined Mixing Models

This paper presents Cramér-Rao Lower Bound (CRLB) for the complex-valued...
research
06/30/2020

Partial Recovery for Top-k Ranking: Optimality of MLE and Sub-Optimality of Spectral Method

Given partially observed pairwise comparison data generated by the Bradl...
research
05/29/2021

The Dantzig selector: Recovery of Signal via ℓ_1-αℓ_2 Minimization

In the paper, we proposed the Dantzig selector based on the ℓ_1-αℓ_2 (0<...
research
06/11/2019

Orthogonal Cocktail BPSK: Exceeding Shannon Capacity of QPSK Input

Shannon channel capacity of an additive white Gaussian noise channel is ...
research
04/16/2015

Multichannel sparse recovery of complex-valued signals using Huber's criterion

In this paper, we generalize Huber's criterion to multichannel sparse re...
research
10/23/2019

Fast Independent Vector Extraction by Iterative SINR Maximization

We propose fast independent vector extraction (FIVE), a new algorithm th...

Please sign up or login with your details

Forgot password? Click here to reset