A novel approach to generate datasets with XAI ground truth to evaluate image models

02/11/2023
by   Miquel Miró-Nicolau, et al.
0

With the increased usage of artificial intelligence (AI), it is imperative to understand how these models work internally. These needs have led to the development of a new field called eXplainable artificial intelligence (XAI). This field consists of on a set of techniques that allows us to theoretically determine the cause of the AI decisions. One unsolved question about XAI is how to measure the quality of explanations. In this study, we propose a new method to generate datasets with ground truth (GT). These datasets allow us to measure how faithful is a method without ad hoc solutions. We conducted a set of experiments that compared our GT with real model explanations and obtained excellent results confirming that our proposed method is correct.

READ FULL TEXT

page 6

page 7

research
07/18/2023

What's meant by explainable model: A Scoping Review

We often see the term explainable in the titles of papers that describe ...
research
11/18/2020

Data Representing Ground-Truth Explanations to Evaluate XAI Methods

Explainable artificial intelligence (XAI) methods are currently evaluate...
research
05/03/2023

Calibrated Explanations: with Uncertainty Information and Counterfactuals

Artificial Intelligence (AI) has become an integral part of decision sup...
research
08/11/2023

FunnyBirds: A Synthetic Vision Dataset for a Part-Based Analysis of Explainable AI Methods

The field of explainable artificial intelligence (XAI) aims to uncover t...
research
02/11/2022

HaT5: Hate Language Identification using Text-to-Text Transfer Transformer

We investigate the performance of a state-of-the art (SoTA) architecture...
research
07/12/2022

BASED-XAI: Breaking Ablation Studies Down for Explainable Artificial Intelligence

Explainable artificial intelligence (XAI) methods lack ground truth. In ...
research
10/28/2019

A Game Theoretic Approach to Class-wise Selective Rationalization

Selection of input features such as relevant pieces of text has become a...

Please sign up or login with your details

Forgot password? Click here to reset