ARTA: Collection and Classification of Ambiguous Requests and Thoughtful Actions

06/15/2021
by   Shohei Tanaka, et al.
0

Human-assisting systems such as dialogue systems must take thoughtful, appropriate actions not only for clear and unambiguous user requests, but also for ambiguous user requests, even if the users themselves are not aware of their potential requirements. To construct such a dialogue agent, we collected a corpus and developed a model that classifies ambiguous user requests into corresponding system actions. In order to collect a high-quality corpus, we asked workers to input antecedent user requests whose pre-defined actions could be regarded as thoughtful. Although multiple actions could be identified as thoughtful for a single user request, annotating all combinations of user requests and system actions is impractical. For this reason, we fully annotated only the test data and left the annotation of the training data incomplete. In order to train the classification model on such training data, we applied the positive/unlabeled (PU) learning method, which assumes that only a part of the data is labeled with positive examples. The experimental results show that the PU learning method achieved better performance than the general positive/negative (PN) learning method to classify thoughtful actions given an ambiguous user request.

READ FULL TEXT

page 1

page 2

page 3

page 4

10/08/2012

Mining Permission Request Patterns from Android and Facebook Applications (extended author version)

Android and Facebook provide third-party applications with access to use...
05/30/2021

NeuralWOZ: Learning to Collect Task-Oriented Dialogue via Model-Based Simulation

We propose NeuralWOZ, a novel dialogue collection framework that uses mo...
04/18/2018

Dialogue Learning with Human Teaching and Feedback in End-to-End Trainable Task-Oriented Dialogue Systems

In this work, we present a hybrid learning method for training task-orie...
08/17/2020

Resolving Intent Ambiguities by Retrieving Discriminative Clarifying Questions

Task oriented Dialogue Systems generally employ intent detection systems...
04/14/2022

Dialogue Strategy Adaptation to New Action Sets Using Multi-dimensional Modelling

A major bottleneck for building statistical spoken dialogue systems for ...
12/22/2019

Hybrid Machine Learning Models of Classifying Residential Requests for Smart Dispatching

This paper presents a hybrid machine learning method of classifying resi...
02/14/2022

Intent-Aware Permission Architecture: A Model for Rethinking Informed Consent for Android Apps

As data privacy continues to be a crucial human-right concern as recogni...