Generating User-Centred Explanations via Illocutionary Question Answering: From Philosophy to Interfaces

10/02/2021
by   Francesco Sovrano, et al.
University of Bologna
16

We propose a new method for generating explanations with Artificial Intelligence (AI) and a tool to test its expressive power within a user interface. In order to bridge the gap between philosophy and human-computer interfaces, we show a new approach for the generation of interactive explanations based on a sophisticated pipeline of AI algorithms for structuring natural language documents into knowledge graphs, answering questions effectively and satisfactorily. With this work we aim to prove that the philosophical theory of explanations presented by Achinstein can be actually adapted for being implemented into a concrete software application, as an interactive and illocutionary process of answering questions. Specifically, our contribution is an approach to frame illocution in a computer-friendly way, to achieve user-centrality with statistical question answering. In fact, we frame illocution, in an explanatory process, as that mechanism responsible for anticipating the needs of the explainee in the form of unposed, implicit, archetypal questions, hence improving the user-centrality of the underlying explanatory process. More precisely, we hypothesise that given an arbitrary explanatory process, increasing its goal-orientedness and degree of illocution results in the generation of more usable (as per ISO 9241-210) explanations. We tested our hypotheses with a user-study involving more than 60 participants, on two XAI-based systems, one for credit approval (finance) and one for heart disease prediction (healthcare). The results showed that our proposed solution produced a statistically significant improvement (hence with a p-value lower than 0.05) on effectiveness. This, combined with a visible alignment between the increments in effectiveness and satisfaction, suggests that our understanding of illocution can be correct, giving evidence in favour of our theory.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 17

page 18

page 22

page 23

page 25

09/09/2021

From Philosophy to Interfaces: an Explanatory Method and a Tool Inspired by Achinstein's Theory of Explanation

We propose a new method for explanations in Artificial Intelligence (AI)...
12/16/2021

Explanation as Question Answering based on Design Knowledge

Explanation of an AI agent requires knowledge of its design and operatio...
07/04/2019

A Road-map Towards Explainable Question Answering A Solution for Information Pollution

The increasing rate of information pollution on the Web requires novel s...
10/16/2020

QA2Explanation: Generating and Evaluating Explanations for Question Answering Systems over Knowledge Graph

In the era of Big Knowledge Graphs, Question Answering (QA) systems have...
03/01/2020

A Study on Multimodal and Interactive Explanations for Visual Question Answering

Explainability and interpretability of AI models is an essential factor ...
11/19/2020

Iterative Planning with Plan-Space Explanations: A Tool and User Study

In a variety of application settings, the user preference for a planning...
06/21/2019

A Comparative Survey of Recent Natural Language Interfaces for Databases

Over the last few years natural language interfaces (NLI) for databases ...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.