MarlRank: Multi-agent Reinforced Learning to Rank

09/15/2019
by   Shihao Zou, et al.
2

When estimating the relevancy between a query and a document, ranking models largely neglect the mutual information among documents. A common wisdom is that if two documents are similar in terms of the same query, they are more likely to have similar relevance score. To mitigate this problem, in this paper, we propose a multi-agent reinforced ranking model, named MarlRank. In particular, by considering each document as an agent, we formulate the ranking process as a multi-agent Markov Decision Process (MDP), where the mutual interactions among documents are incorporated in the ranking process. To compute the ranking list, each document predicts its relevance to a query considering not only its own query-document features but also its similar documents features and actions. By defining reward as a function of NDCG, we can optimize our model directly on the ranking performance measure. Our experimental results on two LETOR benchmark datasets show that our model has significant performance gains over the state-of-art baselines. We also find that the NDCG shows an overall increasing trend along with the step of interactions, which demonstrates that the mutual information among documents helps improve the ranking performance.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/05/2019

A Passage-Based Approach to Learning to Rank Documents

According to common relevance-judgments regimes, such as TREC's, a docum...
research
02/13/2020

Listwise Learning to Rank with Deep Q-Networks

Learning to Rank is the problem involved with ranking a sequence of docu...
research
12/12/2019

SetRank: Learning a Permutation-Invariant Ranking Model for Information Retrieval

In learning-to-rank for information retrieval, a ranking model is automa...
research
09/05/2018

Deep Relevance Ranking Using Enhanced Document-Query Interactions

We explore several new models for document relevance ranking, building u...
research
11/08/2019

Unsupervised Common Question Generation from Multiple Documents using Reinforced Contrastive Coordinator

Web search engines today return a ranked list of document links in respo...
research
09/07/2015

Integrate Document Ranking Information into Confidence Measure Calculation for Spoken Term Detection

This paper proposes an algorithm to improve the calculation of confidenc...
research
11/18/2020

Non-Linear Multiple Field Interactions Neural Document Ranking

Ranking tasks are usually based on the text of the main body of the page...

Please sign up or login with your details

Forgot password? Click here to reset