Do Answers to Boolean Questions Need Explanations? Yes

12/14/2021
by   Sara Rosenthal, et al.
0

Existing datasets that contain boolean questions, such as BoolQ and TYDI QA , provide the user with a YES/NO response to the question. However, a one word response is not sufficient for an explainable system. We promote explainability by releasing a new set of annotations marking the evidence in existing TyDi QA and BoolQ datasets. We show that our annotations can be used to train a model that extracts improved evidence spans compared to models that rely on existing resources. We confirm our findings with a user study which shows that our extracted evidence spans enhance the user experience. We also provide further insight into the challenges of answering boolean questions, such as passages containing conflicting YES and NO answers, and varying degrees of relevance of the predicted evidence.

READ FULL TEXT
research
05/30/2023

Concise Answers to Complex Questions: Summarization of Long-form Answers

Long-form question answering systems provide rich information by present...
research
05/27/2023

Answering Unanswered Questions through Semantic Reformulations in Spoken QA

Spoken Question Answering (QA) is a key feature of voice assistants, usu...
research
09/06/2023

A Refutation of Shapley Values for Explainability

Recent work demonstrated the existence of Boolean functions for which Sh...
research
01/13/2022

Grow-and-Clip: Informative-yet-Concise Evidence Distillation for Answer Explanation

Interpreting the predictions of existing Question Answering (QA) models ...
research
09/13/2021

SituatedQA: Incorporating Extra-Linguistic Contexts into QA

Answers to the same question may change depending on the extra-linguisti...
research
03/13/2019

Natural Language Interaction with Explainable AI Models

This paper presents an explainable AI (XAI) system that provides explana...
research
01/02/2021

Which Linguist Invented the Lightbulb? Presupposition Verification for Question-Answering

Many Question-Answering (QA) datasets contain unanswerable questions, bu...

Please sign up or login with your details

Forgot password? Click here to reset