An end-to-end approach for the verification problem: learning the right distance

02/21/2020
by   João Monteiro, et al.
4

In this contribution, we augment the metric learning setting by introducing a parametric pseudo-distance, trained jointly with the encoder. Several interpretations are thus drawn for the learned distance-like model's output. We first show it approximates a likelihood ratio which can be used for hypothesis tests, and that it further induces a large divergence across the joint distributions of pairs of examples from the same and from different classes. Evaluation is performed under the verification setting consisting of determining whether sets of examples belong to the same class, even if such classes are novel and were never presented to the model during training. Empirical evaluation shows such method defines an end-to-end approach for the verification problem, able to attain better performance than simple scorers such as those based on cosine similarity and further outperforming widely used downstream classifiers. We further observe training is much simplified under the proposed approach compared to metric learning with actual distances, requiring no complex scheme to harvest pairs of examples.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/04/2019

Deep Distributional Sequence Embeddings Based on a Wasserstein Loss

Deep metric learning employs deep neural networks to embed instances int...
research
04/04/2019

Signal-to-Noise Ratio: A Robust Distance Metric for Deep Metric Learning

Deep metric learning, which learns discriminative features to process im...
research
04/16/2023

Learning Empirical Bregman Divergence for Uncertain Distance Representation

Deep metric learning techniques have been used for visual representation...
research
05/10/2021

Semi-Supervised Metric Learning: A Deep Resurrection

Distance Metric Learning (DML) seeks to learn a discriminative embedding...
research
05/28/2019

Learning Bregman Divergences

Metric learning is the problem of learning a task-specific distance func...
research
07/04/2017

Optimization Beyond the Convolution: Generalizing Spatial Relations with End-to-End Metric Learning

To operate intelligently in domestic environments, robots require the ab...
research
06/07/2021

Interactive Label Cleaning with Example-based Explanations

We tackle sequential learning under label noise in applications where a ...

Please sign up or login with your details

Forgot password? Click here to reset