Simplifying Content-Based Neural News Recommendation: On User Modeling and Training Objectives

04/06/2023
by   Andreea Iana, et al.
0

The advent of personalized news recommendation has given rise to increasingly complex recommender architectures. Most neural news recommenders rely on user click behavior and typically introduce dedicated user encoders that aggregate the content of clicked news into user embeddings (early fusion). These models are predominantly trained with standard point-wise classification objectives. The existing body of work exhibits two main shortcomings: (1) despite general design homogeneity, direct comparisons between models are hindered by varying evaluation datasets and protocols; (2) it leaves alternative model designs and training objectives vastly unexplored. In this work, we present a unified framework for news recommendation, allowing for a systematic and fair comparison of news recommenders across several crucial design dimensions: (i) candidate-awareness in user modeling, (ii) click behavior fusion, and (iii) training objectives. Our findings challenge the status quo in neural news recommendation. We show that replacing sizable user encoders with parameter-efficient dot products between candidate and clicked news embeddings (late fusion) often yields substantial performance gains. Moreover, our results render contrastive training a viable alternative to point-wise classification objectives.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/10/2022

News Recommendation with Candidate-aware User Modeling

News recommendation aims to match news with personalized user interest. ...
research
07/29/2023

Train Once, Use Flexibly: A Modular Framework for Multi-Aspect Neural News Recommendation

Recent neural news recommenders (NNR) extend content-based recommendatio...
research
04/10/2022

FUM: Fine-grained and Fast User Modeling for News Recommendation

User modeling is important for news recommendation. Existing methods usu...
research
08/27/2023

Only Encode Once: Making Content-based News Recommender Greener

Large pretrained language models (PLM) have become de facto news encoder...
research
04/15/2021

Two Birds with One Stone: Unified Model Learning for Both Recall and Ranking in News Recommendation

Recall and ranking are two critical steps in personalized news recommend...
research
06/02/2022

DCAN: Diversified News Recommendation with Coverage-Attentive Networks

Self-attention based models are widely used in news recommendation tasks...

Please sign up or login with your details

Forgot password? Click here to reset