Deep Metric Learning Meets Deep Clustering: An Novel Unsupervised Approach for Feature Embedding

09/09/2020
by   Binh X. Nguyen, et al.
0

Unsupervised Deep Distance Metric Learning (UDML) aims to learn sample similarities in the embedding space from an unlabeled dataset. Traditional UDML methods usually use the triplet loss or pairwise loss which requires the mining of positive and negative samples w.r.t. anchor data points. This is, however, challenging in an unsupervised setting as the label information is not available. In this paper, we propose a new UDML method that overcomes that challenge. In particular, we propose to use a deep clustering loss to learn centroids, i.e., pseudo labels, that represent semantic classes. During learning, these centroids are also used to reconstruct the input samples. It hence ensures the representativeness of centroids - each centroid represents visually similar samples. Therefore, the centroids give information about positive (visually similar) and negative (visually dissimilar) samples. Based on pseudo labels, we propose a novel unsupervised metric loss which enforces the positive concentration and negative separation of samples in the embedding space. Experimental results on benchmarking datasets show that the proposed approach outperforms other UDML methods.

READ FULL TEXT
research
08/22/2020

Unsupervised Deep Metric Learning via Orthogonality based Probabilistic Loss

Metric learning is an important problem in machine learning. It aims to ...
research
04/05/2017

Smart Mining for Deep Metric Learning

To solve deep metric learning problems and producing feature embeddings,...
research
03/08/2019

Ranked List Loss for Deep Metric Learning

The objective of deep metric learning (DML) is to learn embeddings that ...
research
07/19/2021

Unsupervised Embedding Learning from Uncertainty Momentum Modeling

Existing popular unsupervised embedding learning methods focus on enhanc...
research
06/17/2022

Improving Generalization of Metric Learning via Listwise Self-distillation

Most deep metric learning (DML) methods employ a strategy that forces al...
research
02/28/2022

Robust Textual Embedding against Word-level Adversarial Attacks

We attribute the vulnerability of natural language processing models to ...
research
03/27/2021

Embedding Transfer with Label Relaxation for Improved Metric Learning

This paper presents a novel method for embedding transfer, a task of tra...

Please sign up or login with your details

Forgot password? Click here to reset