ALEX: Active Learning based Enhancement of a Model's Explainability

09/02/2020
by   Ishani Mondal, et al.
0

An active learning (AL) algorithm seeks to construct an effective classifier with a minimal number of labeled examples in a bootstrapping manner. While standard AL heuristics, such as selecting those points for annotation for which a classification model yields least confident predictions, there has been no empirical investigation to see if these heuristics lead to models that are more interpretable to humans. In the era of data-driven learning, this is an important research direction to pursue. This paper describes our work-in-progress towards developing an AL selection function that in addition to model effectiveness also seeks to improve on the interpretability of a model during the bootstrapping steps. Concretely speaking, our proposed selection function trains an `explainer' model in addition to the classifier model, and favours those instances where a different part of the data is used, on an average, to explain the predicted class. Initial experiments exhibited encouraging trends in showing that such a heuristic can lead to developing more effective and more explainable end-to-end data-driven classifiers.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/10/2021

Active learning for reducing labeling effort in text classification tasks

Labeling data can be an expensive task as it is usually performed manual...
research
08/01/2023

ALE: A Simulation-Based Active Learning Evaluation Framework for the Parameter-Driven Comparison of Query Strategies for NLP

Supervised machine learning and deep learning require a large amount of ...
research
11/02/2020

Reducing Confusion in Active Learning for Part-Of-Speech Tagging

Active learning (AL) uses a data selection algorithm to select useful tr...
research
12/29/2020

Towards Understanding the Optimal Behaviors of Deep Active Learning Algorithms

Active learning (AL) algorithms may achieve better performance with fewe...
research
04/26/2017

On Using Active Learning and Self-Training when Mining Performance Discussions on Stack Overflow

Abundant data is the key to successful machine learning. However, superv...
research
07/30/2014

Targeting Optimal Active Learning via Example Quality

In many classification problems unlabelled data is abundant and a subset...
research
02/05/2015

Estimating Optimal Active Learning via Model Retraining Improvement

A central question for active learning (AL) is: "what is the optimal sel...

Please sign up or login with your details

Forgot password? Click here to reset