FairFuse: Interactive Visual Support for Fair Consensus Ranking

07/15/2022
by   Hilson Shrestha, et al.
0

Fair consensus building combines the preferences of multiple rankers into a single consensus ranking, while ensuring any group defined by a protected attribute (such as race or gender) is not disadvantaged compared to other groups. Manually generating a fair consensus ranking is time-consuming and impractical – even for a fairly small number of candidates. While algorithmic approaches for auditing and generating fair consensus rankings have been developed, these have not been operationalized in interactive systems. To bridge this gap, we introduce FairFuse, a visualization system for generating, analyzing, and auditing fair consensus rankings. We construct a data model which includes base rankings entered by rankers, augmented with measures of group fairness, and algorithms for generating consensus rankings with varying degrees of fairness. We design novel visualizations that encode these measures in a parallel-coordinates style rank visualization, with interactions for generating and exploring fair consensus rankings. We describe use cases in which FairFuse supports a decision-maker in ranking scenarios in which fairness is important, and discuss emerging challenges for future efforts supporting fairness-oriented rank analysis. Code and demo videos available at https://osf.io/hd639/.

READ FULL TEXT

page 1

page 8

research
07/20/2022

MANI-Rank: Multiple Attribute and Intersectional Group Fairness for Consensus Ranking

Combining the preferences of many rankers into one single consensus rank...
research
08/11/2023

Help or Hinder? Evaluating the Impact of Fairness Metrics and Algorithms in Visualizations for Consensus Ranking

For applications where multiple stakeholders provide recommendations, a ...
research
12/12/2021

Fairness for Robust Learning to Rank

While conventional ranking systems focus solely on maximizing the utilit...
research
03/02/2022

Sampling Random Group Fair Rankings

In this paper, we consider the problem of randomized group fair ranking ...
research
11/16/2022

Composite Consensus-Building Process: Permissible Meeting Analysis and Compromise Choice Exploration

In solving today's social issues, it is necessary to determine solutions...
research
08/21/2023

Fair Rank Aggregation

Ranking algorithms find extensive usage in diverse areas such as web sea...
research
04/29/2023

Learning to Re-rank with Constrained Meta-Optimal Transport

Many re-ranking strategies in search systems rely on stochastic ranking ...

Please sign up or login with your details

Forgot password? Click here to reset