Tell Me About Yourself: Using an AI-Powered Chatbot to Conduct Conversational Surveys

05/25/2019
by   Ziang Xiao, et al.
0

The rise of increasingly more powerful chatbots offers a new way to collect information through conversational surveys, where a chatbot asks open-ended questions, interprets a user's free-text responses, and probes answers when needed. To investigate the effectiveness and limitations of such a chatbot in conducting surveys, we conducted a field study involving about 600 participants. In this study, half of the participants took a typical online survey on Qualtrics and the other half interacted with an AI-powered chatbot to complete a conversational survey. Our detailed analysis of over 5200 free-text responses revealed that the chatbot drove a significantly higher level of participant engagement and elicited significantly better quality responses in terms of relevance, depth, and readability. Based on our results, we discuss design implications for creating AI-powered chatbots to conduct effective surveys and beyond.

READ FULL TEXT

page 8

page 17

page 18

05/23/2022

What should I Ask: A Knowledge-driven Approach for Follow-up Questions Generation in Conversational Surveys

Conversational surveys, where an agent asks open-ended questions through...
06/24/2019

Scalable Online Survey Framework: from Sampling to Analysis

With the advancement in technology, raw event data generated by the digi...
10/10/2019

Latent Dirichlet Analysis of Categorical Survey Responses

Data from surveys are increasingly available as the internet provides a ...
03/05/2020

Submitting surveys via a conversational interface: an evaluation of user acceptance and approach effectiveness

Conversational interfaces are currently on the rise: more and more appli...
07/14/2016

Dynamic Question Ordering in Online Surveys

Online surveys have the potential to support adaptive questions, where l...
05/03/2022

Open vs Closed-ended questions in attitudinal surveys – comparing, combining, and interpreting using natural language processing

To improve the traveling experience, researchers have been analyzing the...
01/08/2018

Evorus: A Crowd-powered Conversational Assistant Built to Automate Itself Over Time

Crowd-powered conversational assistants have been shown to be more robus...