Cross-Domain Image Retrieval with Attention Modeling

09/06/2017
by   Xin Ji, et al.
0

With the proliferation of e-commerce websites and the ubiquitousness of smart phones, cross-domain image retrieval using images taken by smart phones as queries to search products on e-commerce websites is emerging as a popular application. One challenge of this task is to locate the attention of both the query and database images. In particular, database images, e.g. of fashion products, on e-commerce websites are typically displayed with other accessories, and the images taken by users contain noisy background and large variations in orientation and lighting. Consequently, their attention is difficult to locate. In this paper, we exploit the rich tag information available on the e-commerce websites to locate the attention of database images. For query images, we use each candidate image in the database as the context to locate the query attention. Novel deep convolutional neural network architectures, namely TagYNet and CtxYNet, are proposed to learn the attention weights and then extract effective representations of the images. Experimental results on public datasets confirm that our approaches have significant improvement over the existing methods in terms of the retrieval accuracy and efficiency.

READ FULL TEXT

page 7

page 8

research
04/13/2022

Scaling Cross-Domain Content-Based Image Retrieval for E-commerce Snap and Search Application

In this industry talk at ECIR 2022, we illustrate how we approach the ma...
research
05/29/2015

Cross-domain Image Retrieval with a Dual Attribute-aware Ranking Network

We address the problem of cross-domain image retrieval, considering the ...
research
09/02/2021

Developing Products Update-Alert System for e-Commerce Websites Users Using HTML Data and Web Scraping Technique

Websites are regarded as domains of limitless information which anyone a...
research
12/17/2013

Learning High-level Image Representation for Image Retrieval via Multi-Task DNN using Clickthrough Data

Image retrieval refers to finding relevant images from an image database...
research
03/03/2017

Context Aware Query Image Representation for Particular Object Retrieval

The current models of image representation based on Convolutional Neural...
research
07/04/2016

Coarse2Fine: Two-Layer Fusion For Image Retrieval

This paper addresses the problem of large-scale image retrieval. We prop...

Please sign up or login with your details

Forgot password? Click here to reset