Deep Learning for Bias Detection: From Inception to Deployment

10/12/2021
by   Md Abul Bashar, et al.
0

To create a more inclusive workplace, enterprises are actively investing in identifying and eliminating unconscious bias (e.g., gender, race, age, disability, elitism and religion) across their various functions. We propose a deep learning model with a transfer learning based language model to learn from manually tagged documents for automatically identifying bias in enterprise content. We first pretrain a deep learning-based language-model using Wikipedia, then fine tune the model with a large unlabelled data set related with various types of enterprise content. Finally, a linear layer followed by softmax layer is added at the end of the language model and the model is trained on a labelled bias dataset consisting of enterprise content. The trained model is thoroughly evaluated on independent datasets to ensure a general application. We present the proposed method and its deployment detail in a real-world application.

READ FULL TEXT
research
02/19/2022

Reward Modeling for Mitigating Toxicity in Transformer-based Language Models

Transformer-based language models are able to generate fluent text and b...
research
04/05/2019

Identifying and Reducing Gender Bias in Word-Level Language Models

Many text corpora exhibit socially problematic biases, which can be prop...
research
11/14/2022

Wikigender: A Machine Learning Model to Detect Gender Bias in Wikipedia

The way Wikipedia's contributors think can influence how they describe i...
research
01/21/2023

Blacks is to Anger as Whites is to Joy? Understanding Latent Affective Bias in Large Pre-trained Neural Language Models

Groundbreaking inventions and highly significant performance improvement...
research
06/09/2022

Uncovering bias in the PlantVillage dataset

We report our investigation on the use of the popular PlantVillage datas...
research
08/01/2022

Learning from flowsheets: A generative transformer model for autocompletion of flowsheets

We propose a novel method enabling autocompletion of chemical flowsheets...
research
09/01/2022

Attack Tactic Identification by Transfer Learning of Language Model

Cybersecurity has become a primary global concern with the rapid increas...

Please sign up or login with your details

Forgot password? Click here to reset