The AIQ Meta-Testbed: Pragmatically Bridging Academic AI Testing and Industrial Q Needs

09/11/2020
by   Markus Borg, et al.
0

AI solutions seem to appear in any and all application domains. As AI becomes more pervasive, the importance of quality assurance increases. Unfortunately, there is no consensus on what artificial intelligence means and interpretations range from simple statistical analysis to sentient humanoid robots. On top of that, quality is a notoriously hard concept to pinpoint. What does this mean for AI quality? In this paper, we share our working definition and a pragmatic approach to address the corresponding quality assurance with a focus on testing. Finally, we present our ongoing work on establishing the AIQ Meta-Testbed.

READ FULL TEXT

page 3

page 4

page 6

research
07/23/2021

Artificial Intelligence in Achieving Sustainable Development Goals

This perspective illustrates some of the AI applications that can accele...
research
12/10/2019

Datamorphic Testing: A Methodology for Testing AI Applications

With the rapid growth of the applications of machine learning (ML) and o...
research
06/09/2022

AAM-Gym: Artificial Intelligence Testbed for Advanced Air Mobility

We introduce AAM-Gym, a research and development testbed for Advanced Ai...
research
07/17/2014

Flow for Meta Control

The psychological state of flow has been linked to optimizing human perf...
research
02/05/2019

Dungeon Crawl Stone Soup as an Evaluation Domain for Artificial Intelligence

Dungeon Crawl Stone Soup is a popular, single-player, free and open-sour...
research
08/21/2022

Do-AIQ: A Design-of-Experiment Approach to Quality Evaluation of AI Mislabel Detection Algorithm

The quality of Artificial Intelligence (AI) algorithms is of significant...
research
11/11/2022

Social Construction of XAI: Do We Need One Definition to Rule Them All?

There is a growing frustration amongst researchers and developers in Exp...

Please sign up or login with your details

Forgot password? Click here to reset