Distillation based Multi-task Learning: A Candidate Generation Model for Improving Reading Duration

02/14/2021
by   Zhong Zhao, et al.
0

In feeds recommendation, the first step is candidate generation. Most of the candidate generation models are based on CTR estimation, which do not consider user's satisfaction with the clicked item. Items with low quality but attractive title (i.e., click baits) may be recommended to the user, which worsens the user experience. One solution to this problem is to model the click and the reading duration simultaneously under the multi-task learning (MTL) framework. There are two challenges in the modeling. The first one is how to deal with the zero duration of the negative samples, which does not necessarily indicate dislikes. The second one is how to perform multi-task learning in the candidate generation model with double tower structure that can only model one single task. In this paper, we propose an distillation based multi-task learning (DMTL) approach to tackle these two challenges. We model duration by considering its dependency of click in the MTL, and then transfer the knowledge learned from the MTL teacher model to the student candidate generation model by distillation. Experiments conducted on dataset gathered from traffic logs of Tencent Kandian's recommender system show that the proposed approach outperforms the competitors significantly in modeling duration, which demonstrates the effectiveness of the proposed candidate generation model.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/09/2019

Attentive Student Meets Multi-Task Teacher: Improved Knowledge Distillation for Pretrained Models

In this paper, we explore the knowledge distillation approach under the ...
research
09/21/2018

Neural Multi-Task Recommendation from Multi-Behavior Data

Most existing recommender systems leverage user behavior data of one typ...
research
02/20/2022

Cross-Task Knowledge Distillation in Multi-Task Recommendation

Multi-task learning (MTL) has been widely used in recommender systems, w...
research
09/12/2023

Hierarchical Multi-Task Learning Framework for Session-based Recommendations

While session-based recommender systems (SBRSs) have shown superior reco...
research
10/15/2020

Aerodynamic Data Predictions Based on Multi-task Learning

The quality of datasets is one of the key factors that affect the accura...
research
07/08/2019

Data Distillation, Face-Related Tasks, Multi Task Learning, Semi-Supervised Learning

We propose a new semi-supervised learning method on face-related tasks b...
research
08/22/2020

LT4REC:A Lottery Ticket Hypothesis Based Multi-task Practice for Video Recommendation System

Click-through rate prediction (CTR) and post-click conversion rate predi...

Please sign up or login with your details

Forgot password? Click here to reset