Reinforcement Learning to Rank with Coarse-grained Labels

08/16/2022
by   Zhichao Xu, et al.
0

Ranking lies at the core of many Information Retrieval (IR) tasks. While existing research on Learning to Rank (LTR) using Deep Neural Network (DNN) has achieved great success, it is somewhat limited because of its dependence on fine-grained labels. In practice, fine-grained labels are often expensive to acquire, i.e. explicit relevance judgements, or suffer from biases, i.e. click logs. Compared to fine-grained labels, coarse-grained labels are easier and cheaper to collect. Some recent works propose utilizing only coarse-grained labels for LTR tasks. A most representative line of work introduces Reinforcement Learning (RL) algorithms. RL can help train the LTR model with little reliance on fine-grained labels compared to Supervised Learning. To study the effectiveness of the RL-based LTR algorithm on coarse-grained labels, in this paper, we implement four different RL paradigms and conduct extensive experiments on two well-established LTR datasets. The results on simulated coarse-grained labeled dataset show that while using coarse-grained labels to train an RL model for LTR tasks still can not outperform traditional approaches using fine-grained labels, it still achieve somewhat promising results and is potentially helpful for future research in LTR. Our code implementations will be released after this work is accepted.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/25/2020

Grafit: Learning fine-grained image representations with coarse labels

This paper tackles the problem of learning a finer representation than t...
research
08/22/2021

Efficient Algorithms for Learning from Coarse Labels

For many learning problems one may not have access to fine grained label...
research
12/28/2022

Parsing Objects at a Finer Granularity: A Survey

Fine-grained visual parsing, including fine-grained part segmentation an...
research
06/08/2021

Coarse-to-Fine Curriculum Learning

When faced with learning challenging new tasks, humans often follow sequ...
research
04/18/2021

Keyphrase Generation with Fine-Grained Evaluation-Guided Reinforcement Learning

Aiming to generate a set of keyphrases, Keyphrase Generation (KG) is a c...
research
03/16/2023

Commonsense Knowledge Assisted Deep Learning for Resource-constrained and Fine-grained Object Detection

In this paper, we consider fine-grained image object detection in resour...
research
11/25/2020

No Subclass Left Behind: Fine-Grained Robustness in Coarse-Grained Classification Problems

In real-world classification tasks, each class often comprises multiple ...

Please sign up or login with your details

Forgot password? Click here to reset