Tell Me About Yourself: Using an AI-Powered Chatbot to Conduct Conversational Surveys

by   Ziang Xiao, et al.

The rise of increasingly more powerful chatbots offers a new way to collect information through conversational surveys, where a chatbot asks open-ended questions, interprets a user's free-text responses, and probes answers when needed. To investigate the effectiveness and limitations of such a chatbot in conducting surveys, we conducted a field study involving about 600 participants. In this study, half of the participants took a typical online survey on Qualtrics and the other half interacted with an AI-powered chatbot to complete a conversational survey. Our detailed analysis of over 5200 free-text responses revealed that the chatbot drove a significantly higher level of participant engagement and elicited significantly better quality responses in terms of relevance, depth, and readability. Based on our results, we discuss design implications for creating AI-powered chatbots to conduct effective surveys and beyond.


page 8

page 17

page 18


What should I Ask: A Knowledge-driven Approach for Follow-up Questions Generation in Conversational Surveys

Conversational surveys, where an agent asks open-ended questions through...

Scalable Online Survey Framework: from Sampling to Analysis

With the advancement in technology, raw event data generated by the digi...

Latent Dirichlet Analysis of Categorical Survey Responses

Data from surveys are increasingly available as the internet provides a ...

Submitting surveys via a conversational interface: an evaluation of user acceptance and approach effectiveness

Conversational interfaces are currently on the rise: more and more appli...

Dynamic Question Ordering in Online Surveys

Online surveys have the potential to support adaptive questions, where l...

Open vs Closed-ended questions in attitudinal surveys – comparing, combining, and interpreting using natural language processing

To improve the traveling experience, researchers have been analyzing the...

Evorus: A Crowd-powered Conversational Assistant Built to Automate Itself Over Time

Crowd-powered conversational assistants have been shown to be more robus...