Information-Theoretic Active Learning for Content-Based Image Retrieval

09/07/2018
by   Björn Barz, et al.
6

We propose Information-Theoretic Active Learning (ITAL), a novel batch-mode active learning method for binary classification, and apply it for acquiring meaningful user feedback in the context of content-based image retrieval. Instead of combining different heuristics such as uncertainty, diversity, or density, our method is based on maximizing the mutual information between the predicted relevance of the images and the expected user feedback regarding the selected batch. We propose suitable approximations to this computationally demanding problem and also integrate an explicit model of user behavior that accounts for possible incorrect labels and unnameable instances. Furthermore, our approach does not only take the structure of the data but also the expected model output change caused by the user feedback into account. In contrast to other methods, ITAL turns out to be highly flexible and provides state-of-the-art performance across various datasets, such as MIRFLICKR and ImageNet.

READ FULL TEXT

page 2

page 21

research
06/21/2020

An Improved Relevance Feedback in CBIR

Relevance Feedback in Content-Based Image Retrieval is a method where th...
research
10/02/2014

PinView: Implicit Feedback in Content-Based Image Retrieval

This paper describes PinView, a content-based image retrieval system tha...
research
02/12/2018

Fast Interactive Image Retrieval using large-scale unlabeled data

An interactive image retrieval system learns which images in the databas...
research
02/18/2020

Information Condensing Active Learning

We introduce Information Condensing Active Learning (ICAL), a batch mode...
research
08/01/2022

Unifying Approaches in Data Subset Selection via Fisher Information and Information-Theoretic Quantities

The mutual information between predictions and model parameters – also r...
research
12/24/2011

Bayesian Active Learning for Classification and Preference Learning

Information theoretic active learning has been widely studied for probab...
research
05/08/2018

Image Retrieval with Mixed Initiative and Multimodal Feedback

How would you search for a unique, fashionable shoe that a friend wore a...

Please sign up or login with your details

Forgot password? Click here to reset