DeepAI AI Chat
Log In Sign Up

Language (Technology) is Power: A Critical Survey of "Bias" in NLP

by   Su Lin Blodgett, et al.

We survey 146 papers analyzing "bias" in NLP systems, finding that their motivations are often vague, inconsistent, and lacking in normative reasoning, despite the fact that analyzing "bias" is an inherently normative process. We further find that these papers' proposed quantitative techniques for measuring or mitigating "bias" are poorly matched to their motivations and do not engage with the relevant literature outside of NLP. Based on these findings, we describe the beginnings of a path forward by proposing three recommendations that should guide work analyzing "bias" in NLP systems. These recommendations rest on a greater recognition of the relationships between language and social hierarchies, encouraging researchers and practitioners to articulate their conceptualizations of "bias"—i.e., what kinds of system behaviors are harmful, in what ways, to whom, and why, as well as the normative reasoning underlying these statements—and to center work around the lived experiences of members of communities affected by NLP systems, while interrogating and reimagining the power relations between technologists and such communities.


A Survey on Gender Bias in Natural Language Processing

Language can be used as a means of reproducing and enforcing harmful ste...

How to Write a Bias Statement: Recommendations for Submissions to the Workshop on Gender Bias in NLP

At the Workshop on Gender Bias in NLP (GeBNLP), we'd like to encourage a...

A Survey of Race, Racism, and Anti-Racism in NLP

Despite inextricable ties between race and language, little work has con...

With Little Power Comes Great Responsibility

Despite its importance to experimental design, statistical power (the pr...

Language technology practitioners as language managers: arbitrating data bias and predictive bias in ASR

Despite the fact that variation is a fundamental characteristic of natur...

A Survey of Parameters Associated with the Quality of Benchmarks in NLP

Several benchmarks have been built with heavy investment in resources to...