AI Chat AI Image Generator AI Video Text to Speech

Inter-Rater Reliability is Individual Fairness

08/10/2023

∙

by Tim Räz, et al.

∙

∙

In this note, a connection between inter-rater reliability and individual fairness is established. It is shown that inter-rater reliability is a special case of individual fairness, a notion of fairness requiring that similar people are treated similarly.

page 1

page 2

page 3

page 4

research

∙ 04/25/2022

Gerrymandering Individual Fairness

Individual fairness, proposed by Dwork et al., is a fairness measure tha...

0 Tim Räz, et al. ∙

research

∙ 11/13/2020

Metric-Free Individual Fairness with Cooperative Contextual Bandits

Data mining algorithms are increasingly used in automated decision makin...

0 Qian Hu, et al. ∙

research

∙ 08/29/2023

Reliability Gaps Between Groups in COMPAS Dataset

This paper investigates the inter-rater reliability of risk assessment i...

0 Tim Räz, et al. ∙

research

∙ 05/25/2019

Eliciting and Enforcing Subjective Individual Fairness

We revisit the notion of individual fairness first proposed by Dwork et ...

0 Christopher Jung, et al. ∙

research

∙ 03/24/2022

k-Rater Reliability: The Correct Unit of Reliability for Aggregated Human Annotations

Since the inception of crowdsourcing, aggregation has been a common stra...

0 Ka Wong, et al. ∙

research

∙ 09/15/2022

iFlipper: Label Flipping for Individual Fairness

As machine learning becomes prevalent, mitigating any unfairness present...

0 Hantian Zhang, et al. ∙

research

∙ 04/04/2022

Models and Mechanisms for Fairness in Location Data Processing

Location data use has become pervasive in the last decade due to the adv...

11 Sina Shaham, et al. ∙