Information Extraction and Human-Robot Dialogue towards Real-life Tasks: A Baseline Study with the MobileCS Dataset

09/27/2022
by   Hong Liu, et al.
0

Recently, there have merged a class of task-oriented dialogue (TOD) datasets collected through Wizard-of-Oz simulated games. However, the Wizard-of-Oz data are in fact simulated data and thus are fundamentally different from real-life conversations, which are more noisy and casual. Recently, the SereTOD challenge is organized and releases the MobileCS dataset, which consists of real-world dialog transcripts between real users and customer-service staffs from China Mobile. Based on the MobileCS dataset, the SereTOD challenge has two tasks, not only evaluating the construction of the dialogue system itself, but also examining information extraction from dialog transcripts, which is crucial for building the knowledge base for TOD. This paper mainly presents a baseline study of the two tasks with the MobileCS dataset. We introduce how the two baselines are constructed, the problems encountered, and the results. We anticipate that the baselines can facilitate exciting future research to build human-robot dialogue systems for real-life tasks.

READ FULL TEXT
research
04/01/2021

Action-Based Conversations Dataset: A Corpus for Building More In-Depth Task-Oriented Dialogue Systems

Existing goal-oriented dialogue datasets focus mainly on identifying slo...
research
11/12/2021

MS-LaTTE: A Dataset of Where and When To-do Tasks are Completed

Tasks are a fundamental unit of work in the daily lives of people, who a...
research
05/04/2023

NatCS: Eliciting Natural Customer Support Dialogues

Despite growing interest in applications based on natural customer suppo...
research
04/17/2023

LED: A Dataset for Life Event Extraction from Dialogs

Lifelogging has gained more attention due to its wide applications, such...
research
08/07/2022

Data Leaves: Scenario-oriented Metadata for Data Federative Innovation

A method for representing the digest information of each dataset is prop...
research
11/20/2017

Non-Contextual Modeling of Sarcasm using a Neural Network Benchmark

One of the most crucial components of natural human-robot interaction is...
research
05/17/2023

Human Choice Prediction in Language-based Non-Cooperative Games: Simulation-based Off-Policy Evaluation

Persuasion games have been fundamental in economics and AI research, and...

Please sign up or login with your details

Forgot password? Click here to reset