Convergence and Recovery Guarantees of the K-Subspaces Method for Subspace Clustering

06/11/2022
by   Peng Wang, et al.
0

The K-subspaces (KSS) method is a generalization of the K-means method for subspace clustering. In this work, we present local convergence analysis and a recovery guarantee for KSS, assuming data are generated by the semi-random union of subspaces model, where N points are randomly sampled from K ≥ 2 overlapping subspaces. We show that if the initial assignment of the KSS method lies within a neighborhood of a true clustering, it converges at a superlinear rate and finds the correct clustering within Θ(loglog N) iterations with high probability. Moreover, we propose a thresholding inner-product based spectral method for initialization and prove that it produces a point in this neighborhood. We also present numerical results of the studied method to support our theoretical developments.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/25/2019

Theory of Spectral Method for Union of Subspaces-Based Random Geometry Graph

Spectral Method is a commonly used scheme to cluster data points lying c...
research
05/15/2013

Noisy Subspace Clustering via Thresholding

We consider the problem of clustering noisy high-dimensional data points...
research
09/07/2020

Implicit Multidimensional Projection of Local Subspaces

We propose a visualization method to understand the effect of multidimen...
research
04/25/2018

RULLS: Randomized Union of Locally Linear Subspaces for Feature Engineering

Feature engineering plays an important role in the success of a machine ...
research
09/12/2013

Recovery guarantees for exemplar-based clustering

For a certain class of distributions, we prove that the linear programmi...
research
04/19/2011

Robust recovery of multiple subspaces by geometric l_p minimization

We assume i.i.d. data sampled from a mixture distribution with K compone...
research
07/15/2019

Subspace Determination through Local Intrinsic Dimensional Decomposition: Theory and Experimentation

Axis-aligned subspace clustering generally entails searching through eno...

Please sign up or login with your details

Forgot password? Click here to reset