Log In Sign Up

Creation of User Friendly Datasets: Insights from a Case Study concerning Explanations of Loan Denials

by   Ajay Chander, et al.

Most explainable AI (XAI) techniques are concerned with the design of algorithms to explain the AI's decision. However, the data that is used to train these algorithms may contain features that are often incomprehensible to an end-user even with the best XAI algorithms. Thus, the problem of explainability has to be addressed starting right from the data creation step. In this paper, we studied this problem considering the use-case of explaining loan denials to end-users as opposed to AI engineers or domain experts. Motivated by the lack of datasets that are representative of user-friendly explanations, we build the first-of-its-kind dataset that is representative of user-friendly explanations for loan denials. The paper shares some of the insights gained in curating the dataset. First, existing datasets seldom contain features that end users consider as acceptable in understanding a model's decision. Second, understanding of the explanation's context such as the human-in-the-loop seeking the explanation, and the purpose for which an explanation is sought, aids in the creation of user-friendly datasets. Thus, our dataset, which we call Xnet, also contains explanations that serve different purposes: those that educate the loan applicants, and help them take appropriate action towards a future approval. We hope this work will trigger the creation of new user friendly datasets, and serve as a guide for the curation of such datasets.


page 1

page 2

page 3

page 4


Generating User-friendly Explanations for Loan Denials using GANs

Financial decisions impact our lives, and thus everyone from the regulat...

Towards an Explanation Space to Align Humans and Explainable-AI Teamwork

Providing meaningful and actionable explanations to end-users is a funda...

Alterfactual Explanations – The Relevance of Irrelevance for Explaining AI Systems

Explanation mechanisms from the field of Counterfactual Thinking are a w...

Transcending XAI Algorithm Boundaries through End-User-Inspired Design

The boundaries of existing explainable artificial intelligence (XAI) alg...

Modelling GDPR-Compliant Explanations for Trustworthy AI

Through the General Data Protection Regulation (GDPR), the European Unio...

How the Experts Do It: Assessing and Explaining Agent Behaviors in Real-Time Strategy Games

How should an AI-based explanation system explain an agent's complex beh...

Explaining decisions made with AI: A workbook (Use case 1: AI-assisted recruitment tool)

Over the last two years, The Alan Turing Institute and the Information C...