Distance metric learning based on structural neighborhoods for dimensionality reduction and classification performance improvement

02/09/2019
by   Mostafa Razavi Ghods, et al.
0

Distance metric learning can be viewed as one of the fundamental interests in pattern recognition and machine learning, which plays a pivotal role in the performance of many learning methods. One of the effective methods in learning such a metric is to learn it from a set of labeled training samples. The issue of data imbalance is the most important challenge of recent methods. This research tries not only to preserve the local structures but also covers the issue of imbalanced datasets. To do this, the proposed method first tries to extract a low dimensional manifold from the input data. Then, it learns the local neighborhood structures and the relationship of the data points in the ambient space based on the adjacencies of the same data points on the embedded low dimensional manifold. Using the local neighborhood relationships extracted from the manifold space, the proposed method learns the distance metric in a way which minimizes the distance between similar data and maximizes their distance from the dissimilar data points. The evaluations of the proposed method on numerous datasets from the UCI repository of machine learning, and also the KDDCup98 dataset as the most imbalance dataset, justify the supremacy of the proposed approach in comparison with other approaches especially when the imbalance factor is high.

READ FULL TEXT

page 1

page 2

page 3

page 4

02/15/2018

Shamap: Shape-based Manifold Learning

For manifold learning, it is assumed that high-dimensional sample/data p...
12/28/2021

Uniform-in-Phase-Space Data Selection with Iterative Normalizing Flows

Improvements in computational and experimental capabilities are rapidly ...
09/04/2019

Metric Learning from Imbalanced Data

A key element of any machine learning algorithm is the use of a function...
07/29/2016

Dimensionality reduction based on Distance Preservation to Local Mean (DPLM) for SPD matrices and its application in BCI

In this paper, we propose a nonlinear dimensionality reduction algorithm...
04/05/2018

Large Scale Local Online Similarity/Distance Learning Framework based on Passive/Aggressive

Similarity/Distance measures play a key role in many machine learning, p...
09/09/2020

Proxy Network for Few Shot Learning

The use of a few examples for each class to train a predictive model tha...
07/13/2013

Learning an Integrated Distance Metric for Comparing Structure of Complex Networks

Graph comparison plays a major role in many network applications. We oft...