SIR: Similar Image Retrieval for Product Search in E-Commerce

by   Theban Stanley, et al.

We present a similar image retrieval (SIR) platform that is used to quickly discover visually similar products in a catalog of millions. Given the size, diversity, and dynamism of our catalog, product search poses many challenges. It can be addressed by building supervised models to tagging product images with labels representing themes and later retrieving them by labels. This approach suffices for common and perennial themes like "white shirt" or "lifestyle image of TV". It does not work for new themes such as "e-cigarettes", hard-to-define ones such as "image with a promotional badge", or the ones with short relevance span such as "Halloween costumes". SIR is ideal for such cases because it allows us to search by an example, not a pre-defined theme. We describe the steps - embedding computation, encoding, and indexing - that power the approximate nearest neighbor search back-end. We also highlight two applications of SIR. The first one is related to the detection of products with various types of potentially objectionable themes. This application is run with a sense of urgency, hence the typical time frame to train and bootstrap a model is not permitted. Also, these themes are often short-lived based on current trends, hence spending resources to build a lasting model is not justified. The second application is a variant item detection system where SIR helps discover visual variants that are hard to find through text search. We analyze the performance of SIR in the context of these applications.



There are no comments yet.


page 12


The Design and Implementation of a Real Time Visual Search System on JD E-commerce Platform

We present the design and implementation of a visual search system for r...

Identical Image Retrieval using Deep Learning

In recent years, we know that the interaction with images has increased....

Joint Learning of Deep Retrieval Model and Product Quantization based Embedding Index

Embedding index that enables fast approximate nearest neighbor(ANN) sear...

A Study on the Efficient Product Search Service for the Damaged Image Information

With the development of Information and Communication Technologies and t...

Neural Networks for Fashion Image Classification and Visual Search

We discuss two potentially challenging problems faced by the ecommerce i...

Towards Practical Visual Search Engine within Elasticsearch

In this paper, we describe our end-to-end content-based image retrieval ...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.