Attenuating Bias in Word Vectors

01/23/2019
by   Sunipa Dev, et al.
0

Word vector representations are well developed tools for various NLP and Machine Learning tasks and are known to retain significant semantic and syntactic structure of languages. But they are prone to carrying and amplifying bias which can perpetrate discrimination in various applications. In this work, we explore new simple ways to detect the most stereotypically gendered words in an embedding and remove the bias from them. We verify how names are masked carriers of gender bias and then use that as a tool to attenuate bias in embeddings. Further, we extend this property of names to show how names can be used to detect other types of bias in the embeddings such as bias based on race, ethnicity, and age.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/21/2022

Don't Forget About Pronouns: Removing Gender Bias in Language Models Without Losing Factual Gender Information

The representations in large language models contain multiple types of g...
research
04/05/2019

Gender Bias in Contextualized Word Embeddings

In this paper, we quantify, analyze and mitigate gender bias exhibited i...
research
05/23/2023

Run Like a Girl! Sports-Related Gender Bias in Language and Vision

Gender bias in Language and Vision datasets and models has the potential...
research
10/06/2020

Robustness and Reliability of Gender Bias Assessment in WordEmbeddings: The Role of Base Pairs

It has been shown that word embeddings can exhibit gender bias, and vari...
research
10/01/2021

Low Frequency Names Exhibit Bias and Overfitting in Contextualizing Language Models

We use a dataset of U.S. first names with labels based on predominant ge...
research
05/18/2023

In the Name of Fairness: Assessing the Bias in Clinical Record De-identification

Data sharing is crucial for open science and reproducible research, but ...
research
03/15/2021

Using Non-Verbal Expressions as a Tool in Naming Research

Variable and function names are extremely important for program comprehe...

Please sign up or login with your details

Forgot password? Click here to reset