University of Washington at TREC 2020 Fairness Ranking Track

11/03/2020
by   Yunhe Feng, et al.
0

InfoSeeking Lab's FATE (Fairness Accountability Transparency Ethics) group at University of Washington participated in 2020 TREC Fairness Ranking Track. This report describes that track, assigned data and tasks, our group definitions, and our results. Our approach to bringing fairness in retrieval and re-ranking tasks with Semantic Scholar data was to extract various dimensions of author identity. These dimensions included gender and location. We developed modules for these extractions in a way that allowed us to plug them in for either of the tasks as needed. After trying different combinations of relative weights assigned to relevance, gender, and location information, we chose five runs for retrieval and five runs for re-ranking tasks. The results showed that our runs performed below par for re-ranking task, but above average for retrieval.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/11/2021

Overview of the TREC 2020 Fair Ranking Track

This paper provides an overview of the NIST TREC 2020 Fair Ranking track...
research
03/25/2020

Overview of the TREC 2019 Fair Ranking Track

The goal of the TREC Fair Ranking track was to develop a benchmark for e...
research
03/17/2020

Overview of the TREC 2019 deep learning track

The Deep Learning Track is a new track for TREC 2019, with the goal of s...
research
05/21/2020

Opportunistic Multi-aspect Fairness through Personalized Re-ranking

As recommender systems have become more widespread and moved into areas ...
research
05/06/2023

Fairness in Image Search: A Study of Occupational Stereotyping in Image Retrieval and its Debiasing

Multi-modal search engines have experienced significant growth and wides...
research
04/28/2021

Societal Biases in Retrieved Contents: Measurement Framework and Adversarial Mitigation for BERT Rankers

Societal biases resonate in the retrieved contents of information retrie...
research
01/25/2023

Group fairness in dynamic refugee assignment

Ensuring that refugees and asylum seekers thrive (e.g., find employment)...

Please sign up or login with your details

Forgot password? Click here to reset