Assessing User Expertise in Spoken Dialog System Interactions

01/18/2017
by   Eugénio Ribeiro, et al.
0

Identifying the level of expertise of its users is important for a system since it can lead to a better interaction through adaptation techniques. Furthermore, this information can be used in offline processes of root cause analysis. However, not much effort has been put into automatically identifying the level of expertise of an user, especially in dialog-based interactions. In this paper we present an approach based on a specific set of task related features. Based on the distribution of the features among the two classes - Novice and Expert - we used Random Forests as a classification approach. Furthermore, we used a Support Vector Machine classifier, in order to perform a result comparison. By applying these approaches on data from a real system, Let's Go, we obtained preliminary results that we consider positive, given the difficulty of the task and the lack of competing approaches for comparison.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/20/2019

Modeling Intent, Dialog Policies and Response Adaptation for Goal-Oriented Interactions

Building a machine learning driven spoken dialog system for goal-oriente...
research
06/06/2023

Toward More Accurate and Generalizable Evaluation Metrics for Task-Oriented Dialogs

Measurement of interaction quality is a critical task for the improvemen...
research
04/06/2022

Quick Starting Dialog Systems with Paraphrase Generation

Acquiring training data to improve the robustness of dialog systems can ...
research
05/07/2020

Adaptive Dialog Policy Learning with Hindsight and User Modeling

Reinforcement learning methods have been used to compute dialog policies...
research
04/27/2015

A Probabilistic Framework for Representing Dialog Systems and Entropy-Based Dialog Management through Dynamic Stochastic State Evolution

In this paper, we present a probabilistic framework for goal-driven spok...
research
11/09/2020

Joint Estimation of Expertise and Reward Preferences From Human Demonstrations

When a robot learns from human examples, most approaches assume that the...
research
09/29/2020

A network approach to expertise retrieval based on path similarity and credit allocation

With the increasing availability of online scholarly databases, publicat...

Please sign up or login with your details

Forgot password? Click here to reset