Spectral Overlap and a Comparison of Parameter-Free, Dimensionality Reduction Quality Metrics

07/03/2019
by   Jonathan Johannemann, et al.
1

Nonlinear dimensionality reduction methods are a popular tool for data scientists and researchers to visualize complex, high dimensional data. However, while these methods continue to improve and grow in number, it is often difficult to evaluate the quality of a visualization due to a variety of factors such as lack of information about the intrinsic dimension of the data and additional tuning required for many evaluation metrics. In this paper, we seek to provide a systematic comparison of dimensionality reduction quality metrics using datasets where we know the ground truth manifold. We utilize each metric for hyperparameter optimization in popular dimensionality reduction methods used for visualization and provide quantitative metrics to objectively compare visualizations to their original manifold. In our results, we find a few methods that appear to consistently do well and propose the best performer as a benchmark for evaluating dimensionality reduction based visualizations.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/22/2019

A Review, Framework and R toolkit for Exploring, Evaluating, and Comparing Visualizations

This paper gives a review and synthesis of methods of evaluating dimensi...
research
03/17/2023

An evaluation framework for dimensionality reduction through sectional curvature

Unsupervised machine learning lacks ground truth by definition. This pos...
research
03/24/2022

Hierarchical Nearest Neighbor Graph Embedding for Efficient Dimensionality Reduction

Dimensionality reduction is crucial both for visualization and preproces...
research
07/17/2023

Large-Scale Evaluation of Topic Models and Dimensionality Reduction Methods for 2D Text Spatialization

Topic models are a class of unsupervised learning algorithms for detecti...
research
12/09/2019

Self Organizing Nebulous Growths for Robust and Incremental Data Visualization

Non-parametric dimensionality reduction techniques, such as t-SNE and UM...
research
10/03/2017

DimReader: Using auto-differentiation to explain non-linear projections

Non-linear dimensionality reduction (NDR) methods such as LLE and t-SNE ...
research
06/15/2022

"Why Here and Not There?" – Diverse Contrasting Explanations of Dimensionality Reduction

Dimensionality reduction is a popular preprocessing and a widely used to...

Please sign up or login with your details

Forgot password? Click here to reset