DeepAI AI Chat
Log In Sign Up

Comparing Conventional and Conversational Search Interaction using Implicit Evaluation Methods

by   Abhishek Kaushik, et al.
Dublin City University

Conversational search applications offer the prospect of improved user experience in information seeking via agent support. However, it is not clear how searchers will respond to this mode of engagement, in comparison to a conventional user-driven search interface, such as those found in a standard web search engine. We describe a laboratory-based study directly comparing user behaviour for a conventional search interface (CSI) with that of an agent-mediated multiview conversational search interface (MCSI) which extends the CSI. User reaction and search outcomes of the two interfaces are compared using implicit evaluation using five analysis methods: claiming to have a better search experience in contrast to a corresponding standard search interface.


Exploring Current User Web Search Behaviours in Analysis Tasks to be Supported in Conversational Search

Conversational search presents opportunities to support users in their s...

Submitting surveys via a conversational interface: an evaluation of user acceptance and approach effectiveness

Conversational interfaces are currently on the rise: more and more appli...

Sensitive and Scalable Online Evaluation with Theoretical Guarantees

Multileaved comparison methods generalize interleaved comparison methods...

Animating an Autonomous 3D Talking Avatar

One of the main challenges with embodying a conversational agent is anno...

When is ACL's Deadline? A Scientific Conversational Agent

Our conversational agent UKP-ATHENA assists NLP researchers in finding a...

A Conceptual Framework for Implicit Evaluation of Conversational Search Interfaces

Conversational search (CS) has recently become a significant focus of th...

A Multifunction Printer CUI for the Blind

Advances in interface design using touch surfaces creates greater obstac...