DAS: Densely-Anchored Sampling for Deep Metric Learning

07/30/2022
by   Lizhao Liu, et al.
0

Deep Metric Learning (DML) serves to learn an embedding function to project semantically similar data into nearby embedding space and plays a vital role in many applications, such as image retrieval and face recognition. However, the performance of DML methods often highly depends on sampling methods to choose effective data from the embedding space in the training. In practice, the embeddings in the embedding space are obtained by some deep models, where the embedding space is often with barren area due to the absence of training points, resulting in so called "missing embedding" issue. This issue may impair the sample quality, which leads to degenerated DML performance. In this work, we investigate how to alleviate the "missing embedding" issue to improve the sampling quality and achieve effective DML. To this end, we propose a Densely-Anchored Sampling (DAS) scheme that considers the embedding with corresponding data point as "anchor" and exploits the anchor's nearby embedding space to densely produce embeddings without data points. Specifically, we propose to exploit the embedding space around single anchor with Discriminative Feature Scaling (DFS) and multiple anchors with Memorized Transformation Shifting (MTS). In this way, by combing the embeddings with and without data points, we are able to provide more embeddings to facilitate the sampling process thus boosting the performance of DML. Our method is effortlessly integrated into existing DML frameworks and improves them without bells and whistles. Extensive experiments on three benchmark datasets demonstrate the superiority of our method.

READ FULL TEXT
research
06/14/2019

Divide and Conquer the Embedding Space for Metric Learning

Learning the embedding space, where semantically similar objects are loc...
research
09/30/2018

Modeling Uncertainty with Hedged Instance Embedding

Instance embeddings are an efficient and versatile image representation ...
research
05/11/2023

A General Framework for Visualizing Embedding Spaces of Neural Survival Analysis Models Based on Angular Information

We propose a general framework for visualizing any intermediate embeddin...
research
09/14/2022

Learning Deep Optimal Embeddings with Sinkhorn Divergences

Deep Metric Learning algorithms aim to learn an efficient embedding spac...
research
10/26/2020

Fewer is More: A Deep Graph Metric Learning Perspective Using Fewer Proxies

Deep metric learning plays a key role in various machine learning tasks....
research
03/30/2023

Adaptive Cross Batch Normalization for Metric Learning

Metric learning is a fundamental problem in computer vision whereby a mo...
research
02/21/2017

Exemplar-Centered Supervised Shallow Parametric Data Embedding

Metric learning methods for dimensionality reduction in combination with...

Please sign up or login with your details

Forgot password? Click here to reset