Prompt Learning for News Recommendation

04/11/2023
by   Zizhuo Zhang, et al.
0

Some recent news recommendation (NR) methods introduce a Pre-trained Language Model (PLM) to encode news representation by following the vanilla pre-train and fine-tune paradigm with carefully-designed recommendation-specific neural networks and objective functions. Due to the inconsistent task objective with that of PLM, we argue that their modeling paradigm has not well exploited the abundant semantic information and linguistic knowledge embedded in the pre-training process. Recently, the pre-train, prompt, and predict paradigm, called prompt learning, has achieved many successes in natural language processing domain. In this paper, we make the first trial of this new paradigm to develop a Prompt Learning for News Recommendation (Prompt4NR) framework, which transforms the task of predicting whether a user would click a candidate news as a cloze-style mask-prediction task. Specifically, we design a series of prompt templates, including discrete, continuous, and hybrid templates, and construct their corresponding answer spaces to examine the proposed Prompt4NR framework. Furthermore, we use the prompt ensembling to integrate predictions from multiple prompt templates. Extensive experiments on the MIND dataset validate the effectiveness of our Prompt4NR with a set of new benchmark results.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/15/2021

Empowering News Recommendation with Pre-trained Language Models

Personalized news recommendation is an essential technique for online ne...
research
04/15/2021

MM-Rec: Multimodal News Recommendation

Accurate news representation is critical for news recommendation. Most o...
research
04/25/2023

PUNR: Pre-training with User Behavior Modeling for News Recommendation

News recommendation aims to predict click behaviors based on user behavi...
research
12/02/2021

Tiny-NewsRec: Efficient and Effective PLM-based News Recommendation

Personalized news recommendation has been widely adopted to improve user...
research
10/11/2022

DIGAT: Modeling News Recommendation with Dual-Graph Interaction

News recommendation (NR) is essential for online news services. Existing...
research
11/09/2021

Neural News Recommendation with Event Extraction

A key challenge of online news recommendation is to help users find arti...
research
03/30/2022

Position-based Prompting for Health Outcome Generation

Probing Pre-trained Language Models (PLMs) using prompts has indirectly ...

Please sign up or login with your details

Forgot password? Click here to reset