Contrastive Information Transfer for Pre-Ranking Systems

07/07/2022
by   Yue Cao, et al.
0

Real-word search and recommender systems usually adopt a multi-stage ranking architecture, including matching, pre-ranking, ranking, and re-ranking. Previous works mainly focus on the ranking stage while very few focus on the pre-ranking stage. In this paper, we focus on the information transfer from ranking to pre-ranking stage. We propose a new Contrastive Information Transfer (CIT) framework to transfer useful information from ranking model to pre-ranking model. We train the pre-ranking model to distinguish the positive pair of representation from a set of positive and negative pairs with a contrastive objective. As a consequence, the pre-ranking model can make full use of rich information in ranking model's representations. The CIT framework also has the advantage of alleviating selection bias and improving the performance of recall metrics, which is crucial for pre-ranking models. We conduct extensive experiments including offline datasets and online A/B testing. Experimental results show that CIT achieves superior results than competitive models. In addition, a strict online A/B testing at one of the world's largest E-commercial platforms shows that the proposed model achieves 0.63% improvements on CTR and 1.64% improvements on VBR. The proposed model now has been deployed online and serves the main traffic of this system, contributing a remarkable business growth.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/03/2022

On Ranking Consistency of Pre-ranking Stage

Industrial ranking systems, such as advertising systems, rank items by a...
research
07/31/2020

COLD: Towards the Next Generation of Pre-Ranking System

Multi-stage cascade architecture exists widely in many industrial system...
research
04/05/2023

Both Efficiency and Effectiveness! A Large Scale Pre-ranking Framework in Search System

In the realm of search systems, multi-stage cascade architecture is a pr...
research
05/23/2023

Rethinking the Role of Pre-ranking in Large-scale E-Commerce Searching System

E-commerce search systems such as Taobao Search, the largest e-commerce ...
research
06/08/2023

Controllable Multi-Objective Re-ranking with Policy Hypernetworks

Multi-stage ranking pipelines have become widely used strategies in mode...
research
05/28/2023

Optimizing Airbnb Search Journey with Multi-task Learning

At Airbnb, an online marketplace for stays and experiences, guests often...
research
05/08/2018

Reasoning with Sarcasm by Reading In-between

Sarcasm is a sophisticated speech act which commonly manifests on social...

Please sign up or login with your details

Forgot password? Click here to reset