DeepAI
Log In Sign Up

A survey on improving NLP models with human explanations

04/19/2022
by   Mareike Hartmann, et al.
0

Training a model with access to human explanations can improve data efficiency and model performance on in- and out-of-domain data. Adding to these empirical findings, similarity with the process of human learning makes learning from explanations a promising way to establish a fruitful human-machine interaction. Several methods have been proposed for improving natural language processing (NLP) models with human explanations, that rely on different explanation types and mechanism for integrating these explanations into the learning process. These methods are rarely compared with each other, making it hard for practitioners to choose the best combination of explanation type and integration mechanism for a specific use-case. In this paper, we give an overview of different methods for learning from human explanations, and discuss different factors that can inform the decision of which method to choose for a specific use-case.

READ FULL TEXT

page 1

page 2

page 3

page 4

05/25/2020

NILE : Natural Language Inference with Faithful Natural Language Explanations

The recent growth in the popularity and success of deep learning models ...
06/22/2021

On the Diversity and Limits of Human Explanations

A growing effort in NLP aims to build datasets of human explanations. Ho...
05/08/2021

On Guaranteed Optimal Robust Explanations for NLP Models

We build on abduction-based explanations for ma-chine learning and devel...
04/30/2021

Explanation-Based Human Debugging of NLP Models: A Survey

To fix a bug in a program, we need to locate where the bug is, understan...
04/09/2021

Individual Explanations in Machine Learning Models: A Case Study on Poverty Estimation

Machine learning methods are being increasingly applied in sensitive soc...
06/29/2021

On the Interaction of Belief Bias and Explanations

A myriad of explainability methods have been proposed in recent years, b...
06/05/2022

Use-Case-Grounded Simulations for Explanation Evaluation

A growing body of research runs human subject evaluations to study wheth...