Algorithmic Unfairness through the Lens of EU Non-Discrimination Law: Or Why the Law is not a Decision Tree

by   Hilde Weerts, et al.

Concerns regarding unfairness and discrimination in the context of artificial intelligence (AI) systems have recently received increased attention from both legal and computer science scholars. Yet, the degree of overlap between notions of algorithmic bias and fairness on the one hand, and legal notions of discrimination and equality on the other, is often unclear, leading to misunderstandings between computer science and law. What types of bias and unfairness does the law address when it prohibits discrimination? What role can fairness metrics play in establishing legal compliance? In this paper, we aim to illustrate to what extent European Union (EU) non-discrimination law coincides with notions of algorithmic fairness proposed in computer science literature and where they differ. The contributions of this paper are as follows. First, we analyse seminal examples of algorithmic unfairness through the lens of EU non-discrimination law, drawing parallels with EU case law. Second, we set out the normative underpinnings of fairness metrics and technical interventions and compare these to the legal reasoning of the Court of Justice of the EU. Specifically, we show how normative assumptions often remain implicit in both disciplinary approaches and explain the ensuing limitations of current AI practice and non-discrimination law. We conclude with implications for AI practitioners and regulators.


Towards a Flexible Framework for Algorithmic Fairness

Increasingly, scholars seek to integrate legal and technological insight...

Why Fairness Cannot Be Automated: Bridging the Gap Between EU Non-Discrimination Law and AI

This article identifies a critical incompatibility between European noti...

Fairness and Explainability in Automatic Decision-Making Systems. A challenge for computer science and law

The paper offers a contribution to the interdisciplinary constructs of a...

Distributive Justice and Fairness Metrics in Automated Decision-making: How Much Overlap Is There?

The advent of powerful prediction algorithms led to increased automation...

Análisis jurídico de la discriminación algorítmica en los procesos de selección laboral

The use of machine learning systems in processing job applications has m...

Reviving Purpose Limitation and Data Minimisation in Personalisation, Profiling and Decision-Making Systems

This paper determines, through an interdisciplinary law and computer sci...

An Empirical Analysis of Racial Categories in the Algorithmic Fairness Literature

Recent work in algorithmic fairness has highlighted the challenge of def...

Please sign up or login with your details

Forgot password? Click here to reset