A Decomposition Algorithm for Sparse Generalized Eigenvalue Problem

02/26/2018
by   Ganzhao Yuan, et al.
0

Sparse generalized eigenvalue problem arises in a number of standard and modern statistical learning models, including sparse principal component analysis, sparse Fisher discriminant analysis and sparse canonical correlation analysis. However, this problem is difficult to solve since it is NP-hard. In this paper, we consider a new decomposition method to tackle this problem. Specifically, we use random or/and swapping strategies to find a working set and perform global combinatorial search over the small subset of variables. We consider a bisection search method and a coordinate descent method for solving the quadratic fractional programming subproblem. In addition, we provide theoretical analysis for the proposed decomposition algorithm. Extensive experiments on both real-world and synthetic data sets have shown that the proposed method achieves state-of-the-art performance in terms of accuracy.

READ FULL TEXT
research
03/25/2019

Eigenvalue and Generalized Eigenvalue Problems: Tutorial

This paper is a tutorial for eigenvalue and generalized eigenvalue probl...
research
05/27/2019

A Block Decomposition Algorithm for Sparse Optimization

Sparse optimization is a central problem in machine learning and compute...
research
11/19/2017

A Coordinate-wise Optimization Algorithm for Sparse Inverse Covariance Selection

Sparse inverse covariance selection is a fundamental problem for analyzi...
research
12/12/2011

Truncated Power Method for Sparse Eigenvalue Problems

This paper considers the sparse eigenvalue problem, which is to extract ...
research
04/29/2016

Sparse Generalized Eigenvalue Problem: Optimal Statistical Rates via Truncated Rayleigh Flow

Sparse generalized eigenvalue problem plays a pivotal role in a large fa...
research
03/24/2020

An Inverse-free Truncated Rayleigh-Ritz Method for Sparse Generalized Eigenvalue Problem

This paper considers the sparse generalized eigenvalue problem (SGEP), w...
research
05/09/2023

Sparse Sliced Inverse Regression via Random Projection

We propose a novel sparse sliced inverse regression method based on rand...

Please sign up or login with your details

Forgot password? Click here to reset