Shop The Look: Building a Large Scale Visual Shopping System at Pinterest

06/18/2020
by   Raymond Shiau, et al.
5

As online content becomes ever more visual, the demand for searching by visual queries grows correspondingly stronger. Shop The Look is an online shopping discovery service at Pinterest, leveraging visual search to enable users to find and buy products within an image. In this work, we provide a holistic view of how we built Shop The Look, a shopping oriented visual search system, along with lessons learned from addressing shopping needs. We discuss topics including core technology across object detection and visual embeddings, serving infrastructure for realtime inference, and data labeling methodology for training/evaluation data collection and human evaluation. The user-facing impacts of our system design choices are measured through offline evaluations, human relevance judgements, and online A/B experiments. The collective improvements amount to cumulative relative gains of over 160 human relevance judgements and over 80 deployed in production at Pinterest.

READ FULL TEXT

page 1

page 2

page 3

page 5

page 6

research
07/05/2021

Web-Scale Generic Object Detection at Microsoft Bing

In this paper, we present Generic Object Detection (GenOD), one of the l...
research
08/05/2019

Learning a Unified Embedding for Visual Search at Pinterest

At Pinterest, we utilize image embeddings throughout our search and reco...
research
06/10/2017

Visual Search at eBay

In this paper, we propose a novel end-to-end approach for scalable visua...
research
02/13/2022

Uni-Retriever: Towards Learning The Unified Embedding Based Retriever in Bing Sponsored Search

Embedding based retrieval (EBR) is a fundamental building block in many ...
research
03/19/2011

Refining Recency Search Results with User Click Feedback

Traditional machine-learned ranking systems for web search are often tra...
research
04/21/2016

Visual Congruent Ads for Image Search

The quality of user experience online is affected by the relevance and p...
research
11/01/2017

Percent Change Estimation in Large Scale Online Experiments

Online experiments are a fundamental component of the development of web...

Please sign up or login with your details

Forgot password? Click here to reset