Learning from User Interactions with Rankings: A Unification of the Field

12/09/2020
by   Harrie Oosterhuis, et al.
0

Ranking systems form the basis for online search engines and recommendation services. They process large collections of items, for instance web pages or e-commerce products, and present the user with a small ordered selection. The goal of a ranking system is to help a user find the items they are looking for with the least amount of effort. Thus the rankings they produce should place the most relevant or preferred items at the top of the ranking. Learning to rank is a field within machine learning that covers methods which optimize ranking systems w.r.t. this goal. Traditional supervised learning to rank methods utilize expert-judgements to evaluate and learn, however, in many situations such judgements are impossible or infeasible to obtain. As a solution, methods have been introduced that perform learning to rank based on user clicks instead. The difficulty with clicks is that they are not only affected by user preferences, but also by what rankings were displayed. Therefore, these methods have to prevent being biased by other factors than user preference. This thesis concerns learning to rank methods based on user clicks and specifically aims to unify the different families of these methods. As a whole, the second part of this thesis proposes a framework that bridges many gaps between areas of online, counterfactual, and supervised learning to rank. It has taken approaches, previously considered independent, and unified them into a single methodology for widely applicable and effective learning to rank from user clicks.

READ FULL TEXT
research
04/27/2017

Consensus measure of rankings

A ranking is an ordered sequence of items, in which an item with higher ...
research
05/18/2020

Policy-Aware Unbiased Learning to Rank for Top-k Rankings

Counterfactual Learning to Rank (LTR) methods optimize ranking systems u...
research
10/19/2019

Online Ranking with Concept Drifts in Streaming Data

Two important problems in preference elicitation are rank aggregation an...
research
11/28/2017

Learning to Rank based on Analogical Reasoning

Object ranking or "learning to rank" is an important problem in the real...
research
11/05/2020

Efficient Online Learning of Optimal Rankings: Dimensionality Reduction via Gradient Descent

We consider a natural model of online preference aggregation, where sets...
research
05/07/2018

Ranking for Relevance and Display Preferences in Complex Presentation Layouts

Learning to Rank has traditionally considered settings where given the r...
research
09/21/2018

Sampler Design for Bayesian Personalized Ranking by Leveraging View Data

Bayesian Personalized Ranking (BPR) is a representative pairwise learnin...

Please sign up or login with your details

Forgot password? Click here to reset