Log In Sign Up

Scattering Transform Based Image Clustering using Projection onto Orthogonal Complement

by   Angel Villar-Corrales, et al.

In the last few years, large improvements in image clustering have been driven by the recent advances in deep learning. However, due to the architectural complexity of deep neural networks, there is no mathematical theory that explains the success of deep clustering techniques. In this work we introduce Projected-Scattering Spectral Clustering (PSSC), a state-of-the-art, stable, and fast algorithm for image clustering, which is also mathematically interpretable. PSSC includes a novel method to exploit the geometric structure of the scattering transform of small images. This method is inspired by the observation that, in the scattering transform domain, the subspaces formed by the eigenvectors corresponding to the few largest eigenvalues of the data matrices of individual classes are nearly shared among different classes. Therefore, projecting out those shared subspaces reduces the intra-class variability, substantially increasing the clustering performance. We call this method Projection onto Orthogonal Complement (POC). Our experiments demonstrate that PSSC obtains the best results among all shallow clustering algorithms. Moreover, it achieves comparable clustering performance to that of recent state-of-the-art clustering techniques, while reducing the execution time by more than one order of magnitude. In the spirit of reproducible research, we publish a high quality code repository along with the paper.


page 1

page 2

page 3

page 4


Geometric Scattering on Manifolds

We present a mathematical model for geometric deep learning based upon a...

Image Segmentation Based on Multiscale Fast Spectral Clustering

In recent years, spectral clustering has become one of the most popular ...

Graph Classification with Geometric Scattering

One of the most notable contributions of deep learning is the applicatio...

Deep Learning by Scattering

We introduce general scattering transforms as mathematical models of dee...

Transformed Subspace Clustering

Subspace clustering assumes that the data is sepa-rable into separate su...

On basis images for the digital image representation

Digital array orthogonal transformations that can be presented as a deco...

Compressing the Input for CNNs with the First-Order Scattering Transform

We study the first-order scattering transform as a candidate for reducin...