Similarity-based Classification: Connecting Similarity Learning to Binary Classification

06/11/2020
by   Han Bao, et al.
6

In real-world classification problems, pairwise supervision (i.e., a pair of patterns with a binary label indicating whether they belong to the same class or not) can often be obtained at a lower cost than ordinary class labels. Similarity learning is a general framework to utilize such pairwise supervision to elicit useful representations by inferring the relationship between two data points, which encompasses various important preprocessing tasks such as metric learning, kernel learning, graph embedding, and contrastive representation learning. Although elicited representations are expected to perform well in downstream tasks such as classification, little theoretical insight has been given in the literature so far. In this paper, we reveal that a specific formulation of similarity learning is strongly related to the objective of binary classification, which spurs us to learn a binary classifier without ordinary class labels—by fitting the product of real-valued prediction functions of pairwise patterns to their similarity. Our formulation of similarity learning does not only generalize many existing ones, but also admits an excess risk bound showing an explicit connection to classification. Finally, we empirically demonstrate the practical usefulness of the proposed method on benchmark datasets.

READ FULL TEXT
research
10/05/2020

Pointwise Binary Classification with Pairwise Confidence Comparisons

Ordinary (pointwise) binary classification aims to learn a binary classi...
research
02/06/2020

Bridging Ordinary-Label Learning and Complementary-Label Learning

Unlike ordinary supervised pattern recognition, in a newly proposed fram...
research
02/03/2020

Learning from Noisy Similar and Dissimilar Data

With the widespread use of machine learning for classification, it becom...
research
06/12/2023

Making Binary Classification from Multiple Unlabeled Datasets Almost Free of Supervision

Training a classifier exploiting a huge amount of supervised data is exp...
research
04/14/2020

Learning from Aggregate Observations

We study the problem of learning from aggregate observations where super...
research
04/19/2023

Denoising Cosine Similarity: A Theory-Driven Approach for Efficient Representation Learning

Representation learning has been increasing its impact on the research a...
research
08/22/2019

Learning Similarity Conditions Without Explicit Supervision

Many real-world tasks require models to compare images along multiple si...

Please sign up or login with your details

Forgot password? Click here to reset