Does Gender Matter? Towards Fairness in Dialogue Systems

10/16/2019
by   Haochen Liu, et al.
0

Recently there are increasing concerns about the fairness of Artificial Intelligence (AI) in real-world applications such as computer vision and recommendations. For example, recognition algorithms in computer vision are unfair to black people such as poorly detecting their faces and inappropriately identifying them as "gorillas". As one crucial application of AI, dialogue systems have been extensively applied in our society. They are usually built with real human conversational data; thus they could inherit some fairness issues which are held in the real world. However, the fairness of dialogue systems has not been investigated. In this paper, we perform the initial study about the fairness issues in dialogue systems. In particular, we construct the first dataset and propose quantitative measures to understand fairness in dialogue models. Our studies demonstrate that popular dialogue models show significant prejudice towards different genders and races. We will release the dataset and the measurement code later to foster the fairness research in dialogue systems.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/13/2022

Inherent Limitations of AI Fairness

As the real-world impact of Artificial Intelligence (AI) systems has bee...
research
04/16/2023

Fairness in AI and Its Long-Term Implications on Society

Successful deployment of artificial intelligence (AI) in various setting...
research
05/25/2022

Helpfulness and Fairness of Task-Oriented Dialogue Systems

Task-oriented dialogue systems aim to answer questions from users and pr...
research
07/11/2019

MeetUp! A Corpus of Joint Activity Dialogues in a Visual Environment

Building computer systems that can converse about their visual environme...
research
08/05/2022

Bias and Fairness in Computer Vision Applications of the Criminal Justice System

Discriminatory practices involving AI-driven police work have been the s...
research
07/20/2022

AI Fairness: from Principles to Practice

This paper summarizes and evaluates various approaches, methods, and tec...

Please sign up or login with your details

Forgot password? Click here to reset