DeepAI
Log In Sign Up

Understanding How Dimension Reduction Tools Work: An Empirical Approach to Deciphering t-SNE, UMAP, TriMAP, and PaCMAP for Data Visualization

12/08/2020
by   Yingfan Wang, et al.
11

Dimension reduction (DR) techniques such as t-SNE, UMAP, and TriMAP have demonstrated impressive visualization performance on many real world datasets. One tension that has always faced these methods is the trade-off between preservation of global structure and preservation of local structure: these methods can either handle one or the other, but not both. In this work, our main goal is to understand what aspects of DR methods are important for preserving both local and global structure: it is difficult to design a better method without a true understanding of the choices we make in our algorithms and their empirical impact on the lower-dimensional embeddings they produce. Towards the goal of local structure preservation, we provide several useful design principles for DR loss functions based on our new understanding of the mechanisms behind successful DR methods. Towards the goal of global structure preservation, our analysis illuminates that the choice of which components to preserve is important. We leverage these insights to design a new algorithm for DR, called Pairwise Controlled Manifold Approximation Projection (PaCMAP), which preserves both local and global structure. Our work provides several unexpected insights into what design choices both to make and avoid when constructing DR algorithms.

READ FULL TEXT

page 12

page 15

page 16

06/14/2021

HUMAP: Hierarchical Uniform Manifold Approximation and Projection

Dimensionality reduction (DR) techniques help analysts to understand pat...
01/31/2022

A Probabilistic Graph Coupling View of Dimension Reduction

Most popular dimension reduction (DR) methods like t-SNE and UMAP are ba...
05/01/2022

Uniform Manifold Approximation with Two-phase Optimization

We introduce Uniform Manifold Approximation with Two-phase Optimization ...
09/24/2019

Dimension Estimation Using Autoencoders

Dimension Estimation (DE) and Dimension Reduction (DR) are two closely r...
09/16/2020

Visualizing structure and transitions in high-dimensional biological data

The high-dimensional data created by high-throughput technologies requir...
07/05/2021

An Analytical Survey on Recent Trends in High Dimensional Data Visualization

Data visualization is the process by which data of any size or dimension...
12/16/2017

Taming Wild High Dimensional Text Data with a Fuzzy Lash

The bag of words (BOW) represents a corpus in a matrix whose elements ar...

Code Repositories

PaCMAP

PaCMAP: Large-scale Dimension Reduction Technique Preserving Both Global and Local Structure


view repo