An Analysis of Approaches Taken in the ACM RecSys Challenge 2018 for Automatic Music Playlist Continuation

10/02/2018
by   Hamed Zamani, et al.
0

The ACM Recommender Systems Challenge 2018 focused on the task of automatic music playlist continuation, which is a form of the more general task of sequential recommendation. Given a playlist of arbitrary length with some additional meta-data, the task was to recommend up to 500 tracks that fit the target characteristics of the original playlist. For the RecSys Challenge, Spotify released a dataset of one million user-generated playlists. Participants could compete in two tracks, i.e., main and creative tracks. Participants in the main track were only allowed to use the provided training set, however, in the creative track, the use of external public sources was permitted. In total, 113 teams submitted 1,228 runs to the main track; 33 teams submitted 239 runs to the creative track. The highest performing team in the main track achieved an R-precision of 0.2241, an NDCG of 0.3946, and an average number of recommended songs clicks of 1.784. In the creative track, an R-precision of 0.2233, an NDCG of 0.3939, and a click rate of 1.785 was obtained by the best team. This article provides an overview of the challenge, including motivation, task definition, dataset description, and evaluation. We further report and analyze the results obtained by the top performing teams in each track and explore the approaches taken by the winners. We finally summarize our key findings and list the open avenues and possible future directions in the area of automatic playlist continuation.

READ FULL TEXT
research
08/13/2018

Automatic Playlist Continuation through a Composition of Collaborative Filters

The RecSys Challenge 2018 focused on automatic playlist continuation, i....
research
01/29/2018

Benchmarking Clinical Decision Support Search

Finding relevant literature underpins the practice of evidence-based med...
research
08/24/2020

A Computational Analysis of Real-World DJ Mixes using Mix-To-Track Subsequence Alignment

A DJ mix is a sequence of music tracks concatenated seamlessly, typicall...
research
03/29/2021

TREC 2020 Podcasts Track Overview

The Podcast Track is new at the Text Retrieval Conference (TREC) in 2020...
research
01/02/2019

Automatic playlist continuation using a hybrid recommender system combining features from text and audio

The ACM RecSys Challenge 2018 focuses on music recommendation in the con...
research
02/09/2018

Understanding Chatbot-mediated Task Management

Effective task management is essential to successful team collaboration....
research
08/04/2021

Predicting Music Relistening Behavior Using the ACT-R Framework

Providing suitable recommendations is of vital importance to improve the...

Please sign up or login with your details

Forgot password? Click here to reset