Dimensionality Reduction using Similarity-induced Embeddings

06/18/2017
by   Nikolaos Passalis, et al.
0

The vast majority of Dimensionality Reduction (DR) techniques rely on second-order statistics to define their optimization objective. Even though this provides adequate results in most cases, it comes with several shortcomings. The methods require carefully designed regularizers and they are usually prone to outliers. In this work, a new DR framework, that can directly model the target distribution using the notion of similarity instead of distance, is introduced. The proposed framework, called Similarity Embedding Framework, can overcome the aforementioned limitations and provides a conceptually simpler way to express optimization targets similar to existing DR techniques. Deriving a new DR technique using the Similarity Embedding Framework becomes simply a matter of choosing an appropriate target similarity matrix. A variety of classical tasks, such as performing supervised dimensionality reduction and providing out-of-of-sample extensions, as well as, new novel techniques, such as providing fast linear embeddings for complex techniques, are demonstrated in this paper using the proposed framework. Six datasets from a diverse range of domains are used to evaluate the proposed method and it is demonstrated that it can outperform many existing DR techniques.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/15/2022

Transformer-based dimensionality reduction

Recently, Transformer is much popular and plays an important role in the...
research
06/29/2021

Interactive Dimensionality Reduction for Comparative Analysis

Finding the similarities and differences between groups of datasets is a...
research
08/01/2023

ZADU: A Python Library for Evaluating the Reliability of Dimensionality Reduction Embeddings

Dimensionality reduction (DR) techniques inherently distort the original...
research
10/31/2018

Dimensionality Reduction has Quantifiable Imperfections: Two Geometric Bounds

In this paper, we investigate Dimensionality reduction (DR) maps in an i...
research
11/13/2018

Interactive dimensionality reduction using similarity projections

Recent advances in machine learning allow us to analyze and describe the...
research
10/03/2020

Perplexity-free Parametric t-SNE

The t-distributed Stochastic Neighbor Embedding (t-SNE) algorithm is a u...
research
06/20/2021

ExplorerTree: a focus+context exploration approach for 2D embeddings

In exploratory tasks involving high-dimensional datasets, dimensionality...

Please sign up or login with your details

Forgot password? Click here to reset