A Wizard of Oz Study Simulating API Usage Dialogues with a Virtual Assistant

06/23/2021
by   Zachary Eberhart, et al.
0

Virtual Assistant technology is rapidly proliferating to improve productivity in a variety of tasks. While several virtual assistants for everyday tasks are well-known (e.g., Siri, Cortana, Alexa), assistants for specialty tasks such as software engineering are rarer. One key reason software engineering assistants are rare is that very few experimental datasets are available and suitable for training the AI that is the bedrock of current virtual assistants. In this paper, we present a set of Wizard of Oz experiments that we designed to build a dataset for creating a virtual assistant. Our target is a hypothetical virtual assistant for helping programmers use APIs. In our experiments, we recruited 30 professional programmers to complete programming tasks using two APIs. The programmers interacted with a simulated virtual assistant for help - the programmers were not aware that the assistant was actually operated by human experts. We then annotated the dialogue acts in the corpus along four dimensions: illocutionary intent, API information type(s), backward-facing function, and traceability to specific API components. We observed a diverse range of interactions that will facilitate the development of dialogue strategies for virtual assistants for API usage.

READ FULL TEXT
research
01/27/2020

The Apiza Corpus: API Usage Dialogues with a Simulated Virtual Assistant

Virtual assistant technology has the potential to make a significant imp...
research
03/11/2023

Virtual Mouse And Assistant: A Technological Revolution Of Artificial Intelligence

The purpose of this paper is to enhance the performance of the virtual a...
research
08/09/2023

Adaptive Intellect Unleashed: The Feasibility of Knowledge Transfer in Large Language Models

We conduct the first empirical study on using knowledge transfer to impr...
research
07/26/2021

Dialogue Management for Interactive API Search

API search involves finding components in an API that are relevant to a ...
research
06/13/2018

Detecting Speech Act Types in Developer Question/Answer Conversations During Bug Repair

This paper targets the problem of speech act detection in conversations ...
research
11/02/2017

TCPSnitch: Dissecting the Usage of the Socket API

Networked applications interact with the TCP/IP stack through the socket...
research
09/15/2022

ESAVE: Estimating Server and Virtual Machine Energy

Sustainable software engineering has received a lot of attention in rece...

Please sign up or login with your details

Forgot password? Click here to reset