An Analysis of Object Embeddings for Image Retrieval

05/28/2019
by   Bor-Chun Chen, et al.
0

We present an analysis of embeddings extracted from different pre-trained models for content-based image retrieval. Specifically, we study embeddings from image classification and object detection models. We discover that even with additional human annotations such as bounding boxes and segmentation masks, the discriminative power of the embeddings based on modern object detection models is significantly worse than their classification counterparts for the retrieval task. At the same time, our analysis also unearths that object detection model can help retrieval task by acting as a hard attention module for extracting object embeddings that focus on salient region from the convolutional feature map. In order to efficiently extract object embeddings, we introduce a simple guided student-teacher training paradigm for learning discriminative embeddings within the object detection framework. We support our findings with strong experimental results.

READ FULL TEXT
research
03/27/2023

What Can Human Sketches Do for Object Detection?

Sketches are highly expressive, inherently capturing subjective and fine...
research
11/02/2018

The Open Images Dataset V4: Unified image classification, object detection, and visual relationship detection at scale

We present Open Images V4, a dataset of 9.2M images with unified annotat...
research
12/21/2021

Contrastive Object Detection Using Knowledge Graph Embeddings

Object recognition for the most part has been approached as a one-hot pr...
research
08/26/2021

An Automatic Image Content Retrieval Method for better Mobile Device Display User Experiences

A growing number of commercially available mobile phones come with integ...
research
08/26/2020

Keypoint-Aligned Embeddings for Image Retrieval and Re-identification

Learning embeddings that are invariant to the pose of the object is cruc...
research
01/10/2022

Why-So-Deep: Towards Boosting Previously Trained Models for Visual Place Recognition

Deep learning-based image retrieval techniques for the loop closure dete...
research
04/07/2023

Language-aware Multiple Datasets Detection Pretraining for DETRs

Pretraining on large-scale datasets can boost the performance of object ...

Please sign up or login with your details

Forgot password? Click here to reset