Towards Evaluating User Profiling Methods Based on Explicit Ratings on Item Features

08/29/2019
by   Luca Luciano Costanzo, et al.
0

In order to improve the accuracy of recommendations, many recommender systems nowadays use side information beyond the user rating matrix, such as item content. These systems build user profiles as estimates of users' interest on content (e.g., movie genre, director or cast) and then evaluate the performance of the recommender system as a whole e.g., by their ability to recommend relevant and novel items to the target user. The user profile modelling stage, which is a key stage in content-driven RS is barely properly evaluated due to the lack of publicly available datasets that contain user preferences on content features of items. To raise awareness of this fact, we investigate differences between explicit user preferences and implicit user profiles. We create a dataset of explicit preferences towards content features of movies, which we release publicly. We then compare the collected explicit user feature preferences and implicit user profiles built via state-of-the-art user profiling models. Our results show a maximum average pairwise cosine similarity of 58.07% between the explicit feature preferences and the implicit user profiles modelled by the best investigated profiling method and considering movies' genres only. For actors and directors, this maximum similarity is only 9.13% and 17.24%, respectively. This low similarity between explicit and implicit preference models encourages a more in-depth study to investigate and improve this important user profile modelling step, which will eventually translate into better recommendations.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/24/2020

Content-Based Personalized Recommender System Using Entity Embeddings

Recommender systems are a class of machine learning algorithms that prov...
research
10/29/2018

Explicit Feedbacks Meet with Implicit Feedbacks : A Combined Approach for Recommendation System

Recommender systems recommend items more accurately by analyzing users' ...
research
04/20/2017

Using Mise-En-Scène Visual Features based on MPEG-7 and Deep Learning for Movie Recommendation

Item features play an important role in movie recommender systems, where...
research
10/20/2018

Temporal Proximity induces Attributes Similarity

Users consume their favorite content in temporal proximity of consumptio...
research
06/27/2016

Content-Based Top-N Recommendation using Heterogeneous Relations

Top-N recommender systems have been extensively studied. However, the sp...
research
07/25/2019

Style Conditioned Recommendations

We propose Style Conditioned Recommendations (SCR) and introduce style i...
research
06/09/2020

Eliciting Touristic Profiles: A User Study on Picture Collections

Eliciting the preferences and needs of tourists is challenging, since pe...

Please sign up or login with your details

Forgot password? Click here to reset