DeepAI AI Chat
Log In Sign Up

Comparing Conventional and Conversational Search Interaction using Implicit Evaluation Methods

03/16/2023
by   Abhishek Kaushik, et al.
Dublin City University
0

Conversational search applications offer the prospect of improved user experience in information seeking via agent support. However, it is not clear how searchers will respond to this mode of engagement, in comparison to a conventional user-driven search interface, such as those found in a standard web search engine. We describe a laboratory-based study directly comparing user behaviour for a conventional search interface (CSI) with that of an agent-mediated multiview conversational search interface (MCSI) which extends the CSI. User reaction and search outcomes of the two interfaces are compared using implicit evaluation using five analysis methods: claiming to have a better search experience in contrast to a corresponding standard search interface.

READ FULL TEXT
04/09/2021

Exploring Current User Web Search Behaviours in Analysis Tasks to be Supported in Conversational Search

Conversational search presents opportunities to support users in their s...
03/05/2020

Submitting surveys via a conversational interface: an evaluation of user acceptance and approach effectiveness

Conversational interfaces are currently on the rise: more and more appli...
11/26/2017

Sensitive and Scalable Online Evaluation with Theoretical Guarantees

Multileaved comparison methods generalize interleaved comparison methods...
03/13/2019

Animating an Autonomous 3D Talking Avatar

One of the main challenges with embodying a conversational agent is anno...
11/23/2019

When is ACL's Deadline? A Scientific Conversational Agent

Our conversational agent UKP-ATHENA assists NLP researchers in finding a...
04/08/2021

A Conceptual Framework for Implicit Evaluation of Conversational Search Interfaces

Conversational search (CS) has recently become a significant focus of th...
06/13/2020

A Multifunction Printer CUI for the Blind

Advances in interface design using touch surfaces creates greater obstac...