Situated Data, Situated Systems: A Methodology to Engage with Power Relations in Natural Language Processing Research

11/11/2020
by   Lucy Havens, et al.
0

We propose a bias-aware methodology to engage with power relations in natural language processing (NLP) research. NLP research rarely engages with bias in social contexts, limiting its ability to mitigate bias. While researchers have recommended actions, technical methods, and documentation practices, no methodology exists to integrate critical reflections on bias with technical NLP methods. In this paper, after an extensive and interdisciplinary literature review, we contribute a bias-aware methodology for NLP research. We also contribute a definition of biased text, a discussion of the implications of biased NLP systems, and a case study demonstrating how we are executing the bias-aware methodology in research on archival metadata descriptions.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/16/2023

On the Origins of Bias in NLP through the Lens of the Jim Code

In this paper, we trace the biases in current natural language processin...
research
10/13/2022

Differential Bias: On the Perceptibility of Stance Imbalance in Argumentation

Most research on natural language processing treats bias as an absolute ...
research
11/24/2022

Undesirable biases in NLP: Averting a crisis of measurement

As Natural Language Processing (NLP) technology rapidly develops and spr...
research
05/28/2020

Language (Technology) is Power: A Critical Survey of "Bias" in NLP

We survey 146 papers analyzing "bias" in NLP systems, finding that their...
research
03/12/2017

Why we have switched from building full-fledged taxonomies to simply detecting hypernymy relations

The study of taxonomies and hypernymy relations has been extensive on th...
research
11/20/2021

Exploring Language Patterns in a Medical Licensure Exam Item Bank

This study examines the use of natural language processing (NLP) models ...
research
03/24/2023

The crime of being poor

The criminalization of poverty has been widely denounced as a collective...

Please sign up or login with your details

Forgot password? Click here to reset