Explain and Predict, and then Predict again

01/11/2021
by   Zijian Zhang, et al.
0

A desirable property of learning systems is to be both effective and interpretable. Towards this goal, recent models have been proposed that first generate an extractive explanation from the input text and then generate a prediction on just the explanation called explain-then-predict models. These models primarily consider the task input as a supervision signal in learning an extractive explanation and do not effectively integrate rationales data as an additional inductive bias to improve task performance. We propose a novel yet simple approach ExPred, that uses multi-task learning in the explanation generation phase effectively trading-off explanation and prediction losses. And then we use another prediction network on just the extracted explanations for optimizing the task performance. We conduct an extensive evaluation of our approach on three diverse language datasets – fact verification, sentiment classification, and QA – and find that we substantially outperform existing approaches.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/12/2020

CUHK at SemEval-2020 Task 4: CommonSense Explanation, Reasoning and Prediction with Multi-task Learning

This paper describes our system submitted to task 4 of SemEval 2020: Com...
research
02/02/2018

How do Humans Understand Explanations from Machine Learning Systems? An Evaluation of the Human-Interpretability of Explanation

Recent years have seen a boom in interest in machine learning systems th...
research
05/29/2017

Contextual Explanation Networks

We introduce contextual explanation networks (CENs)---a class of models ...
research
10/13/2022

Explanations from Large Language Models Make Small Reasoners Better

Integrating free-text explanations to in-context learning of large langu...
research
09/29/2020

Where is the Model Looking At?–Concentrate and Explain the Network Attention

Image classification models have achieved satisfactory performance on ma...
research
02/21/2023

Parallel Sentence-Level Explanation Generation for Real-World Low-Resource Scenarios

In order to reveal the rationale behind model predictions, many works ha...
research
12/17/2021

Explain, Edit, and Understand: Rethinking User Study Design for Evaluating Model Explanations

In attempts to "explain" predictions of machine learning models, researc...

Please sign up or login with your details

Forgot password? Click here to reset