LT4REC:A Lottery Ticket Hypothesis Based Multi-task Practice for Video Recommendation System

08/22/2020
by   Xuanji Xiao, et al.
4

Click-through rate prediction (CTR) and post-click conversion rate prediction (CVR) play key roles across all industrial ranking systems, such as recommendation systems, online advertising, and search engines. Different from the extensive research on CTR, there is much less research on CVR estimation, whose main challenge is extreme data sparsity with one or two orders of magnitude reduction in the number of samples than CTR. People try to solve this problem with the paradigm of multi-task learning with the sufficient samples of CTR, but the typical hard sharing method can't effectively solve this problem, because it is difficult to analyze which parts of network components can be shared and which parts are in conflict, i.e., there is a large inaccuracy with artificially designed neurons sharing. In this paper, we model CVR in a brand-new method by adopting the lottery-ticket-hypothesis-based sparse sharing multi-task learning, which can automatically and flexibly learn which neuron weights to be shared without artificial experience. Experiments on the dataset gathered from traffic logs of Tencent video's recommendation system demonstrate that sparse sharing in the CVR model significantly outperforms competitive methods. Due to the nature of weight sparsity in sparse sharing, it can also significantly reduce computational complexity and memory usage which are very important in the industrial recommendation system.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/03/2023

Click-aware Structure Transfer with Sample Weight Assignment for Post-Click Conversion Rate Estimation

Post-click Conversion Rate (CVR) prediction task plays an essential role...
research
04/21/2018

Entire Space Multi-Task Model: An Effective Approach for Estimating Post-Click Conversion Rate

Estimating post-click conversion rate (CVR) accurately is crucial for ra...
research
11/12/2019

Learning Sparse Sharing Architectures for Multiple Tasks

Most existing deep multi-task learning models are based on parameter sha...
research
09/01/2020

Boosting share routing for multi-task learning

Multi-task learning (MTL) aims to make full use of the knowledge contain...
research
07/24/2019

Predicting Different Types of Conversions with Multi-Task Learning in Online Advertising

Conversion prediction plays an important role in online advertising sinc...
research
02/14/2021

Distillation based Multi-task Learning: A Candidate Generation Model for Improving Reading Duration

In feeds recommendation, the first step is candidate generation. Most of...
research
07/03/2022

Digital-twin-enhanced metal tube bending forming real-time prediction method based on Multi-source-input MTL

As one of the most widely used metal tube bending methods, the rotary dr...

Please sign up or login with your details

Forgot password? Click here to reset