Are Good Explainers Secretly Human-in-the-Loop Active Learners?

06/24/2023
by   Emma Thuong Nguyen, et al.
0

Explainable AI (XAI) techniques have become popular for multiple use-cases in the past few years. Here we consider its use in studying model predictions to gather additional training data. We argue that this is equivalent to Active Learning, where the query strategy involves a human-in-the-loop. We provide a mathematical approximation for the role of the human, and present a general formalization of the end-to-end workflow. This enables us to rigorously compare this use with standard Active Learning algorithms, while allowing for extensions to the workflow. An added benefit is that their utility can be assessed via simulation instead of conducting expensive user-studies. We also present some initial promising results.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/17/2020

Bayesian active learning for production, a systematic study and a reusable library

Active learning is able to reduce the amount of labelling effort by usin...
research
11/07/2020

Human-Like Active Learning: Machines Simulating the Human Learning Process

Although the use of active learning to increase learners' engagement has...
research
03/09/2022

Onception: Active Learning with Expert Advice for Real World Machine Translation

Active learning can play an important role in low-resource settings (i.e...
research
04/07/2023

ASPEST: Bridging the Gap Between Active Learning and Selective Prediction

Selective prediction aims to learn a reliable model that abstains from m...
research
10/27/2020

Take a Chance: Managing the Exploitation-Exploration Dilemma in Customs Fraud Detection via Online Active Learning

Continual labeling of training examples is a costly task in supervised l...
research
01/15/2020

Noise-tolerant, Reliable Active Classification with Comparison Queries

With the explosion of massive, widely available unlabeled data in the pa...
research
09/03/2020

Accelerating engineering design by automatic selection of simulation cases through Pool-Based Active Learning

A common workflow for many engineering design problems requires the eval...

Please sign up or login with your details

Forgot password? Click here to reset