Justice in Misinformation Detection Systems: An Analysis of Algorithms, Stakeholders, and Potential Harms

04/28/2022
by   Terrence Neumann, et al.
0

Faced with the scale and surge of misinformation on social media, many platforms and fact-checking organizations have turned to algorithms for automating key parts of misinformation detection pipelines. While offering a promising solution to the challenge of scale, the ethical and societal risks associated with algorithmic misinformation detection are not well-understood. In this paper, we employ and extend upon the notion of informational justice to develop a framework for explicating issues of justice relating to representation, participation, distribution of benefits and burdens, and credibility in the misinformation detection pipeline. Drawing on the framework: (1) we show how injustices materialize for stakeholders across three algorithmic stages in the pipeline; (2) we suggest empirical measures for assessing these injustices; and (3) we identify potential sources of these harms. This framework should help researchers, policymakers, and practitioners reason about potential harms or risks associated with these algorithms and provide conceptual guidance for the design of algorithmic fairness audits in this domain.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/07/2022

The Ethical Risks of Analyzing Crisis Events on Social Media with Machine Learning

Social media platforms provide a continuous stream of real-time news reg...
research
02/07/2023

Does AI-Assisted Fact-Checking Disproportionately Benefit Majority Groups Online?

In recent years, algorithms have been incorporated into fact-checking pi...
research
08/10/2019

A Mulching Proposal

he ethical implications of algorithmic systems have been much discussed ...
research
10/29/2019

Algorithmic decision-making in AVs: Understanding ethical and technical concerns for smart cities

Autonomous Vehicles (AVs) are increasingly embraced around the world to ...
research
02/25/2021

Tuning as a Means of Assessing the Benefits of New Ideas in Interplay with Existing Algorithmic Modules

Introducing new algorithmic ideas is a key part of the continuous improv...
research
01/30/2021

Computability, Complexity, Consistency and Controllability: A Four C's Framework for cross-disciplinary Ethical Algorithm Research

The ethical consequences of, constraints upon and regulation of algorith...
research
04/12/2020

Individual Fairness in Pipelines

It is well understood that a system built from individually fair compone...

Please sign up or login with your details

Forgot password? Click here to reset