Accelerating E-Commerce Search Engine Ranking by Contextual Factor Selection

03/02/2018
by   Yusen Zhan, et al.
0

In industrial large-scale search systems, such as Taobao.com search for commodities, the quality of the ranking result is getting continually improved by introducing more factors from complex procedures, e.g., deep neural networks for extracting image factors. Meanwhile, the increasing of the factors demands more computation resource and raises the system response latency. It has been observed that a search instance usually requires only a small set of effective factors, instead of all factors. Therefore, removing ineffective factors significantly improves the system efficiency. This paper studies the Contextual Factor Selection (CFS), which selects only a subset of effective factors for every search instance, for a well balance between the search quality and the response latency. We inject CFS into the search engine ranking score to accelerate the engine, considering both ranking effectiveness and efficiency. The learning of the CFS model involves a combinatorial optimization, which is transformed as a sequential decision-making problem. Solving the problem by reinforcement learning, we propose the RankCFS, which has been assessed in an off-line environment as well as a real-world on-line environment (Taobao.com). The empirical results show that, the proposed CFS approach outperforms several existing supervised/unsupervised methods for feature selection in the off-line environment, and also achieves significant real-world performance improvement, in term of service latency, in daily test as well as Singles' Day Shopping Festival in 2017.

READ FULL TEXT
research
05/17/2021

Towards a Better Tradeoff between Effectiveness and Efficiency in Pre-Ranking: A Learnable Feature Selection based Approach

In real-world search, recommendation, and advertising systems, the multi...
research
06/07/2017

Cascade Ranking for Operational E-commerce Search

In the 'Big Data' era, many real-world applications like search involve ...
research
03/26/2018

Demystifying Core Ranking in Pinterest Image Search

Pinterest Image Search Engine helps hundreds of millions of users discov...
research
10/18/2020

Feature Importance Ranking for Deep Learning

Feature importance ranking has become a powerful tool for explainable AI...
research
06/21/2023

AdCraft: An Advanced Reinforcement Learning Benchmark Environment for Search Engine Marketing Optimization

We introduce AdCraft, a novel benchmark environment for the Reinforcemen...
research
03/02/2018

Reinforcement Learning to Rank in E-Commerce Search Engine: Formalization, Analysis, and Application

In e-commerce platforms such as Amazon and TaoBao, ranking items in a se...
research
03/21/2023

Style Miner: Find Significant and Stable Explanatory Factors in Time Series with Constrained Reinforcement Learning

In high-dimensional time-series analysis, it is essential to have a set ...

Please sign up or login with your details

Forgot password? Click here to reset