Unsupervised Dimension Selection using a Blue Noise Spectrum

10/31/2018
by   Jayaraman J. Thiagarajan, et al.
0

Unsupervised dimension selection is an important problem that seeks to reduce dimensionality of data, while preserving the most useful characteristics. While dimensionality reduction is commonly utilized to construct low-dimensional embeddings, they produce feature spaces that are hard to interpret. Further, in applications such as sensor design, one needs to perform reduction directly in the input domain, instead of constructing transformed spaces. Consequently, dimension selection (DS) aims to solve the combinatorial problem of identifying the top-k dimensions, which is required for effective experiment design, reducing data while keeping it interpretable, and designing better sensing mechanisms. In this paper, we develop a novel approach for DS based on graph signal analysis to measure feature influence. By analyzing synthetic graph signals with a blue noise spectrum, we show that we can measure the importance of each dimension. Using experiments in supervised learning and image masking, we demonstrate the superiority of the proposed approach over existing techniques in capturing crucial characteristics of high dimensional spaces, using only a small subset of the original features.

READ FULL TEXT
research
04/09/2013

Image Classification by Feature Dimension Reduction and Graph based Ranking

Dimensionality reduction (DR) of image features plays an important role ...
research
02/12/2013

Adaptive Metric Dimensionality Reduction

We study adaptive data-dependent dimensionality reduction in the context...
research
01/26/2023

SparCA: Sparse Compressed Agglomeration for Feature Extraction and Dimensionality Reduction

The most effective dimensionality reduction procedures produce interpret...
research
02/16/2017

Insense: Incoherent Sensor Selection for Sparse Signals

Sensor selection refers to the problem of intelligently selecting a smal...
research
07/29/2013

Borel Isomorphic Dimensionality Reduction of Data and Supervised Learning

In this project we further investigate the idea of reducing the dimensio...
research
06/03/2021

A Subspace-based Approach for Dimensionality Reduction and Important Variable Selection

An analysis of high dimensional data can offer a detailed description of...
research
02/15/2018

Natural data structure extracted from neighborhood-similarity graphs

'Big' high-dimensional data are commonly analyzed in low-dimensions, aft...

Please sign up or login with your details

Forgot password? Click here to reset