Overview of the TREC 2020 deep learning track

02/15/2021
by   Nick Craswell, et al.
0

This is the second year of the TREC Deep Learning Track, with the goal of studying ad hoc ranking in the large training data regime. We again have a document retrieval task and a passage retrieval task, each with hundreds of thousands of human-labeled training queries. We evaluate using single-shot TREC-style evaluation, to give us a picture of which ranking methods work best when large data is available, with much more comprehensive relevance labeling on the small number of test queries. This year we have further evidence that rankers with BERT-style pretraining outperform other rankers in the large data regime.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/17/2020

Overview of the TREC 2019 deep learning track

The Deep Learning Track is a new track for TREC 2019, with the goal of s...
research
04/19/2021

TREC Deep Learning Track: Reusable Test Collections in the Large Data Regime

The TREC Deep Learning (DL) Track studies ad hoc search in the large dat...
research
05/09/2021

MS MARCO: Benchmarking Ranking Models in the Large-Data Regime

Evaluation efforts such as TREC, CLEF, NTCIR and FIRE, alongside public ...
research
04/24/2023

Overview of the TREC 2022 NeuCLIR Track

This is the first year of the TREC Neural CLIR (NeuCLIR) track, which ai...
research
12/10/2019

Duet at TREC 2019 Deep Learning Track

This report discusses three submissions based on the Duet architecture t...
research
03/25/2020

Overview of the TREC 2019 Fair Ranking Track

The goal of the TREC Fair Ranking track was to develop a benchmark for e...
research
02/24/2023

Naver Labs Europe (SPLADE) @ TREC Deep Learning 2022

This paper describes our participation to the 2022 TREC Deep Learning ch...

Please sign up or login with your details

Forgot password? Click here to reset