Quantifying and Mitigating Popularity Bias in Conversational Recommender Systems

08/05/2022
by   Allen Lin, et al.
1

Conversational recommender systems (CRS) have shown great success in accurately capturing a user's current and detailed preference through the multi-round interaction cycle while effectively guiding users to a more personalized recommendation. Perhaps surprisingly, conversational recommender systems can be plagued by popularity bias, much like traditional recommender systems. In this paper, we systematically study the problem of popularity bias in CRSs. We demonstrate the existence of popularity bias in existing state-of-the-art CRSs from an exposure rate, a success rate, and a conversational utility perspective, and propose a suite of popularity bias metrics designed specifically for the CRS setting. We then introduce a debiasing framework with three unique features: (i) Popularity-Aware Focused Learning to reduce the popularity-distorting impact on preference prediction; (ii) Cold-Start Item Embedding Reconstruction via Attribute Mapping, to improve the modeling of cold-start items; and (iii) Dual-Policy Learning, to better guide the CRS when dealing with either popular or unpopular items. Through extensive experiments on two frequently used CRS datasets, we find the proposed model-agnostic debiasing framework not only mitigates the popularity bias in state-of-the-art CRSs but also improves the overall recommendation performance.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/08/2022

Towards Fair Conversational Recommender Systems

Conversational recommender systems have demonstrated great success. They...
research
08/19/2020

Popularity Bias in Recommendation: A Multi-stakeholder Perspective

Traditionally, especially in academic research in recommender systems, t...
research
03/25/2020

Unfair Exposure of Artists in Music Recommendation

Fairness in machine learning has been studied by many researchers. In pa...
research
04/20/2023

Dealing with Popularity Bias in Recommender Systems for Third-party Libraries: How far Are We?

Recommender systems for software engineering (RSSEs) assist software eng...
research
05/28/2020

A Re-visit of the Popularity Baseline in Recommender Systems

Popularity is often included in experimental evaluation to provide a ref...
research
07/07/2022

Evolution of Popularity Bias: Empirical Study and Debiasing

Popularity bias is a long-standing challenge in recommender systems. Suc...
research
03/18/2022

FORCE: A Framework of Rule-Based Conversational Recommender System

The conversational recommender systems (CRSs) have received extensive at...

Please sign up or login with your details

Forgot password? Click here to reset