Towards a Better Tradeoff between Effectiveness and Efficiency in Pre-Ranking: A Learnable Feature Selection based Approach

05/17/2021
by   Xu Ma, et al.
0

In real-world search, recommendation, and advertising systems, the multi-stage ranking architecture is commonly adopted. Such architecture usually consists of matching, pre-ranking, ranking, and re-ranking stages. In the pre-ranking stage, vector-product based models with representation-focused architecture are commonly adopted to account for system efficiency. However, it brings a significant loss to the effectiveness of the system. In this paper, a novel pre-ranking approach is proposed which supports complicated models with interaction-focused architecture. It achieves a better tradeoff between effectiveness and efficiency by utilizing the proposed learnable Feature Selection method based on feature Complexity and variational Dropout (FSCD). Evaluations in a real-world e-commerce sponsored search system for a search engine demonstrate that utilizing the proposed pre-ranking, the effectiveness of the system is significantly improved. Moreover, compared to the systems with conventional pre-ranking models, an identical amount of computational resource is consumed.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/05/2023

Both Efficiency and Effectiveness! A Large Scale Pre-ranking Framework in Search System

In the realm of search systems, multi-stage cascade architecture is a pr...
research
12/04/2018

EENMF: An End-to-End Neural Matching Framework for E-Commerce Sponsored Search

E-commerce sponsored search contributes an important part of revenue for...
research
03/02/2018

Accelerating E-Commerce Search Engine Ranking by Contextual Factor Selection

In industrial large-scale search systems, such as Taobao.com search for ...
research
06/13/2019

Iterative subtraction method for Feature Ranking

Training features used to analyse physical processes are often highly co...
research
03/02/2022

An Effective Way for Cross-Market Recommendation with Hybrid Pre-Ranking and Ranking Models

The Cross-Market Recommendation task of WSDM CUP 2022 is about finding s...
research
05/03/2022

On Ranking Consistency of Pre-ranking Stage

Industrial ranking systems, such as advertising systems, rank items by a...
research
06/06/2023

COPR: Consistency-Oriented Pre-Ranking for Online Advertising

Cascading architecture has been widely adopted in large-scale advertisin...

Please sign up or login with your details

Forgot password? Click here to reset