Choppy: Cut Transformer For Ranked List Truncation

04/26/2020
by   Dara Bahri, et al.
2

Work in information retrieval has traditionally focused on ranking and relevance: given a query, return some number of results ordered by relevance to the user. However, the problem of determining how many results to return, i.e. how to optimally truncate the ranked result list, has received less attention despite being of critical importance in a range of applications. Such truncation is a balancing act between the overall relevance, or usefulness of the results, with the user cost of processing more results. In this work, we propose Choppy, an assumption-free model based on the widely successful Transformer architecture, to the ranked list truncation problem. Needing nothing more than the relevance scores of the results, the model uses a powerful multi-head attention mechanism to directly optimize any user-defined IR metric. We show Choppy improves upon recent state-of-the-art methods.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/19/2020

Surprise: Result List Truncation via Extreme Value Theory

Work in information retrieval has largely been centered around ranking a...
research
02/25/2021

Learning to Truncate Ranked Lists for Information Retrieval

Ranked list truncation is of critical importance in a variety of profess...
research
12/01/2022

Principled Multi-Aspect Evaluation Measures of Rankings

Information Retrieval evaluation has traditionally focused on defining p...
research
06/09/2021

Learning to Rank Words: Optimizing Ranking Metrics for Word Spotting

In this paper, we explore and evaluate the use of ranking-based objectiv...
research
05/20/2021

Enhancing Cross-Sectional Currency Strategies by Ranking Refinement with Transformer-based Architectures

The performance of a cross-sectional currency strategy depends crucially...
research
04/28/2020

EARL: Speedup Transformer-based Rankers with Pre-computed Representation

Recent innovations in Transformer-based ranking models have advanced the...
research
05/30/2022

Retrieving and Ranking Relevant JavaScript Technologies from Web Repositories

The selection of software technologies is an important but complex task....

Please sign up or login with your details

Forgot password? Click here to reset