Creation of User Friendly Datasets: Insights from a Case Study concerning Explanations of Loan Denials

06/11/2019
by   Ajay Chander, et al.
0

Most explainable AI (XAI) techniques are concerned with the design of algorithms to explain the AI's decision. However, the data that is used to train these algorithms may contain features that are often incomprehensible to an end-user even with the best XAI algorithms. Thus, the problem of explainability has to be addressed starting right from the data creation step. In this paper, we studied this problem considering the use-case of explaining loan denials to end-users as opposed to AI engineers or domain experts. Motivated by the lack of datasets that are representative of user-friendly explanations, we build the first-of-its-kind dataset that is representative of user-friendly explanations for loan denials. The paper shares some of the insights gained in curating the dataset. First, existing datasets seldom contain features that end users consider as acceptable in understanding a model's decision. Second, understanding of the explanation's context such as the human-in-the-loop seeking the explanation, and the purpose for which an explanation is sought, aids in the creation of user-friendly datasets. Thus, our dataset, which we call Xnet, also contains explanations that serve different purposes: those that educate the loan applicants, and help them take appropriate action towards a future approval. We hope this work will trigger the creation of new user friendly datasets, and serve as a guide for the curation of such datasets.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/24/2019

Generating User-friendly Explanations for Loan Denials using GANs

Financial decisions impact our lives, and thus everyone from the regulat...
research
06/02/2021

Towards an Explanation Space to Align Humans and Explainable-AI Teamwork

Providing meaningful and actionable explanations to end-users is a funda...
research
07/19/2022

Alterfactual Explanations – The Relevance of Irrelevance for Explaining AI Systems

Explanation mechanisms from the field of Counterfactual Thinking are a w...
research
05/20/2023

The Case Against Explainability

As artificial intelligence (AI) becomes more prevalent there is a growin...
research
04/18/2023

Impact Of Explainable AI On Cognitive Load: Insights From An Empirical Study

While the emerging research field of explainable artificial intelligence...
research
11/05/2019

Why X rather than Y? Explaining Neural Model' Predictions by Generating Intervention Counterfactual Samples

Even though the topic of explainable AI/ML is very popular in text and c...
research
03/20/2021

Explaining decisions made with AI: A workbook (Use case 1: AI-assisted recruitment tool)

Over the last two years, The Alan Turing Institute and the Information C...

Please sign up or login with your details

Forgot password? Click here to reset