Provably Correct Algorithms for Matrix Column Subset Selection with Selectively Sampled Data

05/17/2015
by   Yining Wang, et al.
0

We consider the problem of matrix column subset selection, which selects a subset of columns from an input matrix such that the input can be well approximated by the span of the selected columns. Column subset selection has been applied to numerous real-world data applications such as population genetics summarization, electronic circuits testing and recommendation systems. In many applications the complete data matrix is unavailable and one needs to select representative columns by inspecting only a small portion of the input matrix. In this paper we propose the first provably correct column subset selection algorithms for partially observed data matrices. Our proposed algorithms exhibit different merits and drawbacks in terms of statistical accuracy, computational efficiency, sample complexity and sampling schemes, which provides a nice exploration of the tradeoff between these desired properties for column subset selection. The proposed methods employ the idea of feedback driven sampling and are inspired by several sampling schemes previously introduced for low-rank matrix approximation tasks [DMM08, FKV04, DV06, KS14]. Our analysis shows that, under the assumption that the input data matrix has incoherent rows but possibly coherent columns, all algorithms provably converge to the best low-rank approximation of the original data as number of selected columns increases. Furthermore, two of the proposed algorithms enjoy a relative error bound, which is preferred for column subset selection and matrix approximation purposes. We also demonstrate through both theoretical and empirical analysis the power of feedback driven sampling compared to uniform random sampling on input matrices with highly correlated columns.

READ FULL TEXT
research
04/16/2020

Average Case Column Subset Selection for Entrywise ℓ_1-Norm Loss

We study the column subset selection problem with respect to the entrywi...
research
12/23/2018

A determinantal point process for column subset selection

Dimensionality reduction is a first step of many machine learning pipeli...
research
06/07/2023

Fair Column Subset Selection

We consider the problem of fair column subset selection. In particular, ...
research
11/01/2017

Sampling and multilevel coarsening algorithms for fast matrix approximations

This paper addresses matrix approximation problems for matrices that are...
research
03/14/2023

Asymptotically Sharp Upper Bound for the Column Subset Selection Problem

This paper investigates the spectral norm version of the column subset s...
research
04/06/2014

Provable Deterministic Leverage Score Sampling

We explain theoretically a curious empirical phenomenon: "Approximating ...
research
07/24/2023

A Statistical View of Column Subset Selection

We consider the problem of selecting a small subset of representative va...

Please sign up or login with your details

Forgot password? Click here to reset