DeepAI AI Chat
Log In Sign Up

Connecting Images through Time and Sources: Introducing Low-data, Heterogeneous Instance Retrieval

by   Dimitri Gominski, et al.

With impressive results in applications relying on feature learning, deep learning has also blurred the line between algorithm and data. Pick a training dataset, pick a backbone network for feature extraction, and voilà ; this usually works for a variety of use cases. But the underlying hypothesis that there exists a training dataset matching the use case is not always met. Moreover, the demand for interconnections regardless of the variations of the content calls for increasing generalization and robustness in features. An interesting application characterized by these problematics is the connection of historical and cultural databases of images. Through the seemingly simple task of instance retrieval, we propose to show that it is not trivial to pick features responding well to a panel of variations and semantic content. Introducing a new enhanced version of the Alegoria benchmark, we compare descriptors using the detailed annotations. We further give insights about the core problems in instance retrieval, testing four state-of-the-art additional techniques to increase performance.


Challenging deep image descriptors for retrieval in heterogeneous iconographic collections

This article proposes to study the behavior of recent and efficient stat...

Learning Models over Relational Data: A Brief Tutorial

This tutorial overviews the state of the art in learning models over rel...

Unsupervised Feature Learning for Writer Identification and Writer Retrieval

Deep Convolutional Neural Networks (CNN) have shown great success in sup...

SIFT Meets CNN: A Decade Survey of Instance Retrieval

In the early days, content-based image retrieval (CBIR) was studied with...

LineFormer: Rethinking Line Chart Data Extraction as Instance Segmentation

Data extraction from line-chart images is an essential component of the ...

Benchmarking unsupervised near-duplicate image detection

Unsupervised near-duplicate detection has many practical applications ra...

An Efficient Metric of Automatic Weight Generation for Properties in Instance Matching Technique

The proliferation of heterogeneous data sources of semantic knowledge ba...