Non-Gaussian Component Analysis via Lattice Basis Reduction

12/16/2021
by   Ilias Diakonikolas, et al.
3

Non-Gaussian Component Analysis (NGCA) is the following distribution learning problem: Given i.i.d. samples from a distribution on ℝ^d that is non-gaussian in a hidden direction v and an independent standard Gaussian in the orthogonal directions, the goal is to approximate the hidden direction v. Prior work <cit.> provided formal evidence for the existence of an information-computation tradeoff for NGCA under appropriate moment-matching conditions on the univariate non-gaussian distribution A. The latter result does not apply when the distribution A is discrete. A natural question is whether information-computation tradeoffs persist in this setting. In this paper, we answer this question in the negative by obtaining a sample and computationally efficient algorithm for NGCA in the regime that A is discrete or nearly discrete, in a well-defined technical sense. The key tool leveraged in our algorithm is the LLL method <cit.> for lattice basis reduction.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/04/2017

Polynomial Time and Sample Complexity for Non-Gaussian Component Analysis: Spectral Methods

The problem of Non-Gaussian Component Analysis (NGCA) is about finding a...
research
07/13/2018

Non-Gaussian Component Analysis using Entropy Methods

Non-Gaussian component analysis (NGCA) is a problem in multidimensional ...
research
06/19/2020

Notion of information and independent component analysis

Partial orderings and measures of information for continuous univariate ...
research
02/29/2016

Beyond CCA: Moment Matching for Multi-View Models

We introduce three novel semi-parametric extensions of probabilistic can...
research
09/02/2015

Heavy-tailed Independent Component Analysis

Independent component analysis (ICA) is the problem of efficiently recov...
research
02/22/2019

A time-distance trade-off for GDD with preprocessing---Instantiating the DLW heuristic

For 0 ≤α≤ 1/2, we show an algorithm that does the following. Given appro...
research
11/09/2012

Efficient learning of simplices

We show an efficient algorithm for the following problem: Given uniforml...

Please sign up or login with your details

Forgot password? Click here to reset