A Nutritional Label for Rankings

04/21/2018
by   Ke Yang, et al.
0

Algorithmic decisions often result in scoring and ranking individuals to determine credit worthiness, qualifications for college admissions and employment, and compatibility as dating partners. While automatic and seemingly objective, ranking algorithms can discriminate against individuals and protected groups, and exhibit low diversity. Furthermore, ranked results are often unstable --- small changes in the input data or in the ranking methodology may lead to drastic changes in the output, making the result uninformative and easy to manipulate. Similar concerns apply in cases where items other than individuals are ranked, including colleges, academic departments, or products. In this demonstration we present Ranking Facts, a Web-based application that generates a "nutritional label" for rankings. Ranking Facts is made up of a collection of visual widgets that implement our latest research results on fairness, stability, and transparency for rankings, and that communicate details of the ranking methodology, or of the output, to the end user. We will showcase Ranking Facts on real datasets from different domains, including college rankings, criminal risk assessment, and financial services.

READ FULL TEXT
research
02/20/2018

Fairness of Exposure in Rankings

Rankings are ubiquitous in the online world today. As we have transition...
research
05/04/2018

Equity of Attention: Amortizing Individual Fairness in Rankings

Rankings of people and items are at the heart of selection-making, match...
research
04/29/2018

On Obtaining Stable Rankings

We often have to rank items with multiple attributes in a dataset. A typ...
research
10/27/2020

Assessing Viewpoint Diversity in Search Results Using Ranking Fairness Metrics

The way pages are ranked in search results influences whether the users ...
research
12/30/2022

Detection of Groups with Biased Representation in Ranking

Real-life tools for decision-making in many critical domains are based o...
research
05/13/2019

Consequential Ranking Algorithms and Long-term Welfare

Ranking models are typically designed to provide rankings that optimize ...
research
09/01/2023

Amortizing Pragmatic Program Synthesis with Rankings

In program synthesis, an intelligent system takes in a set of user-gener...

Please sign up or login with your details

Forgot password? Click here to reset