An Alternating Manifold Proximal Gradient Method for Sparse PCA and Sparse CCA

03/27/2019
by   Shixiang Chen, et al.
0

Sparse principal component analysis (PCA) and sparse canonical correlation analysis (CCA) are two essential techniques from high-dimensional statistics and machine learning for analyzing large-scale data. Both problems can be formulated as an optimization problem with nonsmooth objective and nonconvex constraints. Since non-smoothness and nonconvexity bring numerical difficulties, most algorithms suggested in the literature either solve some relaxations or are heuristic and lack convergence guarantees. In this paper, we propose a new alternating manifold proximal gradient method to solve these two high-dimensional problems and provide a unified convergence analysis. Numerical experiment results are reported to demonstrate the advantages of our algorithm.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/02/2018

Proximal Gradient Method for Manifold Optimization

This paper considers manifold optimization problems with nonsmooth and n...
research
11/19/2019

Gradient-based Sparse Principal Component Analysis with Extensions to Online Learning

Sparse principal component analysis (PCA) is an important technique for ...
research
12/12/2015

Sparse Generalized Principal Component Analysis for Large-scale Applications beyond Gaussianity

Principal Component Analysis (PCA) is a dimension reduction technique. I...
research
06/09/2018

Efficient Optimization Algorithms for Robust Principal Component Analysis and Its Variants

Robust PCA has drawn significant attention in the last decade due to its...
research
04/07/2021

Dynamic Principal Subspaces with Sparsity in High Dimensions

Principal component analysis (PCA) is a versatile tool to reduce the dim...
research
11/04/2013

TOP-SPIN: TOPic discovery via Sparse Principal component INterference

We propose a novel topic discovery algorithm for unlabeled images based ...
research
04/23/2020

Sparse Generalized Canonical Correlation Analysis: Distributed Alternating Iteration based Approach

Sparse canonical correlation analysis (CCA) is a useful statistical tool...

Please sign up or login with your details

Forgot password? Click here to reset