Batch Decorrelation for Active Metric Learning

05/20/2020
by   Priyadarshini K, et al.
15

We present an active learning strategy for training parametric models of distance metrics, given triplet-based similarity assessments: object x_i is more similar to object x_j than to x_k. In contrast to prior work on class-based learning, where the fundamental goal is classification and any implicit or explicit metric is binary, we focus on perceptual metrics that express the degree of (dis)similarity between objects. We find that standard active learning approaches degrade when annotations are requested for batches of triplets at a time: our studies suggest that correlation among triplets is responsible. In this work, we propose a novel method to decorrelate batches of triplets, that jointly balances informativeness and diversity while decoupling the choice of heuristic for each criterion. Experiments indicate our method is general, adaptable, and outperforms the state-of-the-art.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/15/2022

MEAL: Stable and Active Learning for Few-Shot Prompting

Few-shot classification in NLP has recently made great strides due to th...
research
02/15/2021

A Unified Batch Selection Policy for Active Metric Learning

Active metric learning is the problem of incrementally selecting high-ut...
research
07/26/2022

Active Learning of Ordinal Embeddings: A User Study on Football Data

Humans innately measure distance between instances in an unlabeled datas...
research
05/08/2019

PerceptNet: Learning Perceptual Similarity of Haptic Textures in Presence of Unorderable Triplets

In order to design haptic icons or build a haptic vocabulary, we require...
research
03/28/2018

Active Metric Learning for Supervised Classification

Clustering and classification critically rely on distance metrics that p...
research
11/06/2015

Active Perceptual Similarity Modeling with Auxiliary Information

Learning a model of perceptual similarity from a collection of objects i...
research
09/11/2023

Learning Objective-Specific Active Learning Strategies with Attentive Neural Processes

Pool-based active learning (AL) is a promising technology for increasing...

Please sign up or login with your details

Forgot password? Click here to reset