DeepAI AI Chat
Log In Sign Up

A Survey on Methods and Metrics for the Assessment of Explainability under the Proposed AI Act

by   Francesco Sovrano, et al.

This study discusses the interplay between metrics used to measure the explainability of the AI systems and the proposed EU Artificial Intelligence Act. A standardisation process is ongoing: several entities (e.g. ISO) and scholars are discussing how to design systems that are compliant with the forthcoming Act and explainability metrics play a significant role. This study identifies the requirements that such a metric should possess to ease compliance with the AI Act. It does so according to an interdisciplinary approach, i.e. by departing from the philosophical concept of explainability and discussing some metrics proposed by scholars and standardisation entities through the lenses of the explainability obligations set by the proposed AI Act. Our analysis proposes that metrics to measure the kind of explainability endorsed by the proposed AI Act shall be risk-focused, model-agnostic, goal-aware, intelligible accessible. This is why we discuss the extent to which these requirements are met by the metrics currently under discussion.


page 1

page 2

page 3

page 4


Explainability and the Fourth AI Revolution

This chapter discusses AI from the prism of an automated process for the...

Compliance Challenges in Forensic Image Analysis Under the Artificial Intelligence Act

In many applications of forensic image analysis, state-of-the-art result...

Complying with the EU AI Act

The EU AI Act is the proposed EU legislation concerning AI systems. This...

An Audit Framework for Technical Assessment of Binary Classifiers

Multilevel models using logistic regression (MLogRM) and random forest m...

A Framework for Auditing Multilevel Models using Explainability Methods

Applications of multilevel models usually result in binary classificatio...

Impossibility Results in AI: A Survey

An impossibility theorem demonstrates that a particular problem or set o...

An Objective Metric for Explainable AI: How and Why to Estimate the Degree of Explainability

Numerous government initiatives (e.g. the EU with GDPR) are coming to th...