Comparing Conventional and Conversational Search Interaction using Implicit Evaluation Methods

03/16/2023
by   Abhishek Kaushik, et al.
0

Conversational search applications offer the prospect of improved user experience in information seeking via agent support. However, it is not clear how searchers will respond to this mode of engagement, in comparison to a conventional user-driven search interface, such as those found in a standard web search engine. We describe a laboratory-based study directly comparing user behaviour for a conventional search interface (CSI) with that of an agent-mediated multiview conversational search interface (MCSI) which extends the CSI. User reaction and search outcomes of the two interfaces are compared using implicit evaluation using five analysis methods: claiming to have a better search experience in contrast to a corresponding standard search interface.

READ FULL TEXT
research
04/09/2021

Exploring Current User Web Search Behaviours in Analysis Tasks to be Supported in Conversational Search

Conversational search presents opportunities to support users in their s...
research
03/05/2020

Submitting surveys via a conversational interface: an evaluation of user acceptance and approach effectiveness

Conversational interfaces are currently on the rise: more and more appli...
research
11/26/2017

Sensitive and Scalable Online Evaluation with Theoretical Guarantees

Multileaved comparison methods generalize interleaved comparison methods...
research
03/13/2019

Animating an Autonomous 3D Talking Avatar

One of the main challenges with embodying a conversational agent is anno...
research
11/23/2019

When is ACL's Deadline? A Scientific Conversational Agent

Our conversational agent UKP-ATHENA assists NLP researchers in finding a...
research
04/08/2021

A Conceptual Framework for Implicit Evaluation of Conversational Search Interfaces

Conversational search (CS) has recently become a significant focus of th...
research
06/13/2020

A Multifunction Printer CUI for the Blind

Advances in interface design using touch surfaces creates greater obstac...

Please sign up or login with your details

Forgot password? Click here to reset