DeepAI
Log In Sign Up

Active entailment encoding for explanation tree construction using parsimonious generation of hard negatives

08/02/2022
by   Alex Bogatu, et al.
0

Entailment trees have been proposed to simulate the human reasoning process of explanation generation in the context of open–domain textual question answering. However, in practice, manually constructing these explanation trees proves a laborious process that requires active human involvement. Given the complexity of capturing the line of reasoning from question to the answer or from claim to premises, the issue arises of how to assist the user in efficiently constructing multi–level entailment trees given a large set of available facts. In this paper, we frame the construction of entailment trees as a sequence of active premise selection steps, i.e., for each intermediate node in an explanation tree, the expert needs to annotate positive and negative examples of premise facts from a large candidate list. We then iteratively fine–tune pre–trained Transformer models with the resulting positive and tightly controlled negative samples and aim to balance the encoding of semantic relationships and explanatory entailment relationships. Experimental evaluation confirms the measurable efficiency gains of the proposed active fine–tuning method in facilitating entailment trees construction: up to 20% improvement in explanatory premise selection when compared against several alternatives.

READ FULL TEXT

page 1

page 2

page 3

page 4

04/17/2021

Explaining Answers with Entailment Trees

Our goal, in the context of open-domain textual question-answering (QA),...
05/05/2022

METGEN: A Module-Based Entailment Tree Generation Framework for Answer Explanation

Knowing the reasoning chains from knowledge to the predicted answers can...
05/18/2022

Entailment Tree Explanations via Iterative Retrieval-Generation Reasoner

Large language models have achieved high performance on various question...
10/31/2022

RLET: A Reinforcement Learning Based Approach for Explainable QA with Entailment Trees

Interpreting the reasoning process from questions to answers poses a cha...
10/25/2020

ExplanationLP: Abductive Reasoning for Explainable Science Question Answering

We propose a novel approach for answering and explaining multiple-choice...
05/24/2022

Policy Compliance Detection via Expression Tree Inference

Policy Compliance Detection (PCD) is a task we encounter when reasoning ...