Stochastic Neighbor Embedding with Gaussian and Student-t Distributions: Tutorial and Survey

09/22/2020
by   Benyamin Ghojogh, et al.
0

Stochastic Neighbor Embedding (SNE) is a manifold learning and dimensionality reduction method with a probabilistic approach. In SNE, every point is consider to be the neighbor of all other points with some probability and this probability is tried to be preserved in the embedding space. SNE considers Gaussian distribution for the probability in both the input and embedding spaces. However, t-SNE uses the Student-t and Gaussian distributions in these spaces, respectively. In this tutorial and survey paper, we explain SNE, symmetric SNE, t-SNE (or Cauchy-SNE), and t-SNE with general degrees of freedom. We also cover the out-of-sample extension and acceleration for these methods. Some simulations to visualize the embeddings are also provided.

READ FULL TEXT
research
12/31/2020

Divergence Regulated Encoder Network for Joint Dimensionality Reduction and Classification

In this paper, we investigate performing joint dimensionality reduction ...
research
02/09/2017

Stochastic Neighbor Embedding separates well-separated clusters

Stochastic Neighbor Embedding and its variants are widely used dimension...
research
08/27/2020

Multiscale reweighted stochastic embedding (MRSE): Deep learning of collective variables for enhanced sampling

Machine learning methods provide a general framework for automatically f...
research
06/20/2023

Unexplainable Explanations: Towards Interpreting tSNE and UMAP Embeddings

It has become standard to explain neural network latent spaces with attr...
research
07/31/2017

Statistics on the (compact) Stiefel manifold: Theory and Applications

A Stiefel manifold of the compact type is often encountered in many fiel...
research
05/03/2022

A unified view on Self-Organizing Maps (SOMs) and Stochastic Neighbor Embedding (SNE)

We propose a unified view on two widely used data visualization techniqu...

Please sign up or login with your details

Forgot password? Click here to reset