Multi-Head Deep Metric Learning Using Global and Local Representations

12/28/2021
by   Mohammad K. Ebrahimpour, et al.
47

Deep Metric Learning (DML) models often require strong local and global representations, however, effective integration of local and global features in DML model training is a challenge. DML models are often trained with specific loss functions, including pairwise-based and proxy-based losses. The pairwise-based loss functions leverage rich semantic relations among data points, however, they often suffer from slow convergence during DML model training. On the other hand, the proxy-based loss functions often lead to significant speedups in convergence during training, while the rich relations among data points are often not fully explored by the proxy-based losses. In this paper, we propose a novel DML approach to address these challenges. The proposed DML approach makes use of a hybrid loss by integrating the pairwise-based and the proxy-based loss functions to leverage rich data-to-data relations as well as fast convergence. Furthermore, the proposed DML approach utilizes both global and local features to obtain rich representations in DML model training. Finally, we also use the second-order attention for feature enhancement to improve accurate and efficient retrieval. In our experiments, we extensively evaluated the proposed DML approach on four public benchmarks, and the experimental results demonstrate that the proposed method achieved state-of-the-art performance on all benchmarks.

READ FULL TEXT

page 7

page 12

page 13

page 14

page 15

page 16

page 17

page 18

research
03/31/2020

Proxy Anchor Loss for Deep Metric Learning

Existing metric learning losses can be categorized into two classes: pai...
research
06/27/2023

Mean Field Theory in Deep Metric Learning

In this paper, we explore the application of mean field theory, a techni...
research
06/22/2023

Deep Metric Learning with Soft Orthogonal Proxies

Deep Metric Learning (DML) models rely on strong representations and sim...
research
03/08/2019

Ranked List Loss for Deep Metric Learning

The objective of deep metric learning (DML) is to learn embeddings that ...
research
05/05/2022

Do Different Deep Metric Learning Losses Lead to Similar Learned Features?

Recent studies have shown that many deep metric learning loss functions ...
research
07/02/2021

Ensemble of Loss Functions to Improve Generalizability of Deep Metric Learning methods

Deep Metric Learning (DML) learns a non-linear semantic embedding from i...
research
02/28/2023

Global Proxy-based Hard Mining for Visual Place Recognition

Learning deep representations for visual place recognition is commonly p...

Please sign up or login with your details

Forgot password? Click here to reset