Fairness and Accountability Design Needs for Algorithmic Support in High-Stakes Public Sector Decision-Making

02/03/2018
by   Michael Veale, et al.
0

Calls for heightened consideration of fairness and accountability in algorithmically-informed public decisions---like taxation, justice, and child protection---are now commonplace. How might designers support such human values? We interviewed 27 public sector machine learning practitioners across 5 OECD countries regarding challenges understanding and imbuing public values into their work. The results suggest a disconnect between organisational and institutional realities, constraints and needs, and those addressed by current research into usable, transparent and 'discrimination-aware' machine learning---absences likely to undermine practical initiatives unless addressed. We see design opportunities in this disconnect, such as in supporting the tracking of concept drift in secondary data sources, and in building usable transparency tools to identify risks and incorporate domain knowledge, aimed both at managers and at the 'street-level bureaucrats' on the frontlines of public service. We conclude by outlining ethical challenges and future directions for collaboration in these high-stakes applications.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/15/2019

A Human-Centered Approach to Interactive Machine Learning

The interactive machine learning (IML) community aims to augment humans'...
research
04/29/2022

A Human-Centric Perspective on Fairness and Transparency in Algorithmic Decision-Making

Automated decision systems (ADS) are increasingly used for consequential...
research
04/20/2022

A Brief Guide to Designing and Evaluating Human-Centered Interactive Machine Learning

Interactive machine learning (IML) is a field of research that explores ...
research
09/11/2019

FAT Forensics: A Python Toolbox for Algorithmic Fairness, Accountability and Transparency

Machine learning algorithms can take important decisions, sometimes lega...
research
04/14/2023

Systemic Fairness

Machine learning algorithms are increasingly used to make or support dec...
research
06/07/2023

Changing Data Sources in the Age of Machine Learning for Official Statistics

Data science has become increasingly essential for the production of off...
research
05/04/2022

Data Governance in the Age of Large-Scale Data-Driven Language Technology

The recent emergence and adoption of Machine Learning technology, and sp...

Please sign up or login with your details

Forgot password? Click here to reset