Principled Frameworks for Evaluating Ethics in NLP Systems

06/14/2019
by   Shrimai Prabhumoye, et al.
5

We critique recent work on ethics in natural language processing. Those discussions have focused on data collection, experimental design, and interventions in modeling. But we argue that we ought to first understand the frameworks of ethics that are being used to evaluate the fairness and justice of algorithmic systems. Here, we begin that discussion by outlining deontological ethics, and envision a research agenda prioritized by it.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/09/2020

Case Study: Deontological Ethics in NLP

Recent work in natural language processing (NLP) has focused on ethical ...
research
06/21/2023

Utilizing Natural Language Processing for Automated Assessment of Classroom Discussion

Rigorous and interactive class discussions that support students to enga...
research
08/31/2022

Efficient Methods for Natural Language Processing: A Survey

Getting the most out of limited resources allows advances in natural lan...
research
05/06/2021

Reliability Testing for Natural Language Processing Systems

Questions of fairness, robustness, and transparency are paramount to add...
research
11/27/2018

Questioning the assumptions behind fairness solutions

In addition to their benefits, optimization systems can have negative ec...
research
02/24/2022

Welcome to the Modern World of Pronouns: Identity-Inclusive Natural Language Processing beyond Gender

The world of pronouns is changing. From a closed class of words with few...
research
01/27/2018

A Sheaf Model of Contradictions and Disagreements. Preliminary Report and Discussion

We introduce a new formal model -- based on the mathematical construct o...

Please sign up or login with your details

Forgot password? Click here to reset