Defining and Evaluating Fair Natural Language Generation

07/28/2020

∙

by   Catherine Yeo, et al.

∙

0

∙

share

Our work focuses on the biases that emerge in the natural language generation (NLG) task of sentence completion. In this paper, we introduce a framework of fairness for NLG followed by an evaluation of gender biases in two state-of-the-art language models. Our analysis provides a theoretical formulation for biases in NLG and empirical evidence that existing language generation models embed gender bias.