DeepAI
Log In Sign Up

The R-U-A-Robot Dataset: Helping Avoid Chatbot Deception by Detecting User Questions About Human or Non-Human Identity

06/04/2021
by   David Gros, et al.
0

Humans are increasingly interacting with machines through language, sometimes in contexts where the user may not know they are talking to a machine (like over the phone or a text chatbot). We aim to understand how system designers and researchers might allow their systems to confirm its non-human identity. We collect over 2,500 phrasings related to the intent of “Are you a robot?". This is paired with over 2,500 adversarially selected utterances where only confirming the system is non-human would be insufficient or disfluent. We compare classifiers to recognize the intent and discuss the precision/recall and model complexity tradeoffs. Such classifiers could be integrated into dialog systems to avoid undesired deception. We then explore how both a generative research model (Blender) as well as two deployed systems (Amazon Alexa, Google Assistant) handle this intent, finding that systems often fail to confirm their non-human identity. Finally, we try to understand what a good response to the intent would be, and conduct a user study to compare the important aspects when responding to this intent.

READ FULL TEXT

page 1

page 2

page 3

page 4

04/14/2021

Situational Confidence Assistance for Lifelong Shared Autonomy

Shared autonomy enables robots to infer user intent and assist in accomp...
12/23/2016

A Base Camp for Scaling AI

Modern statistical machine learning (SML) methods share a major limitati...
05/11/2018

Bootstrapping Multilingual Intent Models via Machine Translation for Dialog Automation

With the resurgence of chat-based dialog systems in consumer and enterpr...
02/03/2020

IART: Intent-aware Response Ranking with Transformers in Information-seeking Conversation Systems

Personal assistant systems, such as Apple Siri, Google Assistant, Amazon...
04/30/2021

Hierarchical Modeling for Out-of-Scope Domain and Intent Classification

User queries for a real-world dialog system may sometimes fall outside t...
02/03/2022

WatchAuth: User Authentication and Intent Recognition in Mobile Payments using a Smartwatch

In this paper, we show that the tap gesture, performed when a user 'taps...
10/22/2022

Robots-Dont-Cry: Understanding Falsely Anthropomorphic Utterances in Dialog Systems

Dialog systems are often designed or trained to output human-like respon...