DeepAI
Log In Sign Up

Robots-Dont-Cry: Understanding Falsely Anthropomorphic Utterances in Dialog Systems

10/22/2022
by   David Gros, et al.
0

Dialog systems are often designed or trained to output human-like responses. However, some responses may be impossible for a machine to truthfully say (e.g. "that movie made me cry"). Highly anthropomorphic responses might make users uncomfortable or implicitly deceive them into thinking they are interacting with a human. We collect human ratings on the feasibility of approximately 900 two-turn dialogs sampled from 9 diverse data sources. Ratings are for two hypothetical machine embodiments: a futuristic humanoid robot and a digital assistant. We find that for some data-sources commonly used to train dialog systems, 20-30 is marginally affected by machine embodiment. We explore qualitative and quantitative reasons for these ratings. Finally, we build classifiers and explore how modeling configuration might affect output permissibly, and discuss implications for building less falsely anthropomorphic dialog systems.

READ FULL TEXT

page 5

page 14

page 17

04/04/2019

Affect-Driven Dialog Generation

The majority of current systems for end-to-end dialog generation focus o...
12/23/2020

TicketTalk: Toward human-level performance with end-to-end, transaction-based dialog systems

We present a data-driven, end-to-end approach to transaction-based dialo...
05/27/2021

Multi-turn Dialog System on Single-turn Data in Medical Domain

Recently there has been a huge interest in dialog systems. This interest...
06/15/2021

Unsupervised Enrichment of Persona-grounded Dialog with Background Stories

Humans often refer to personal narratives, life experiences, and events ...
05/01/2020

Information Seeking in the Spirit of Learning: a Dataset for Conversational Curiosity

Open-ended human learning and information-seeking are increasingly media...
10/07/2020

"I'd rather just go to bed": Understanding Indirect Answers

We revisit a pragmatic inference problem in dialog: understanding indire...