Adapting SQuaRE for Quality Assessment of Artificial Intelligence Systems

07/31/2019
by   Hiroshi Kuwajima, et al.
0

More and more software practitioners are tackling towards industrial applications of artificial intelligence (AI) systems, especially those based on machine learning (ML). However, many of existing principles and approaches to traditional systems do not work effectively for the system behavior obtained by training not by logical design. In addition, unique kinds of requirements are emerging such as fairness and explainability. To provide clear guidance to understand and tackle these difficulties, we present an analysis on what quality concepts we should evaluate for AI systems. We base our discussion on ISO/IEC 25000 series, known as SQuaRE, and identify how it should be adapted for the unique nature of ML and Ethics guidelines for trustworthy AI from European Commission. We thus provide holistic insights for quality of AI systems by incorporating the ML nature and AI ethics to the traditional software quality concepts.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/16/2020

Quality Management of Machine Learning Systems

In the past decade, Artificial Intelligence (AI) has become a part of ou...
research
12/10/2019

Datamorphic Testing: A Methodology for Testing AI Applications

With the rapid growth of the applications of machine learning (ML) and o...
research
07/29/2022

The Effects of Data Quality on Machine Learning Performance

Modern artificial intelligence (AI) applications require large quantitie...
research
02/24/2021

A Large-Scale, Automated Study of Language Surrounding Artificial Intelligence

This work presents a large-scale analysis of artificial intelligence (AI...
research
08/25/2020

Towards Guidelines for Assessing Qualities of Machine Learning Systems

Nowadays, systems containing components based on machine learning (ML) m...
research
01/09/2023

Architecting Safer Autonomous Aviation Systems

The aviation literature gives relatively little guidance to practitioner...
research
06/20/2023

Guideline for Trustworthy Artificial Intelligence – AI Assessment Catalog

Artificial Intelligence (AI) has made impressive progress in recent year...

Please sign up or login with your details

Forgot password? Click here to reset