DeepAI
Log In Sign Up

Characterizing Technical Debt and Antipatterns in AI-Based Systems: A Systematic Mapping Study

03/17/2021
by   Justus Bogner, et al.
0

Background: With the rising popularity of Artificial Intelligence (AI), there is a growing need to build large and complex AI-based systems in a cost-effective and manageable way. Like with traditional software, Technical Debt (TD) will emerge naturally over time in these systems, therefore leading to challenges and risks if not managed appropriately. The influence of data science and the stochastic nature of AI-based systems may also lead to new types of TD or antipatterns, which are not yet fully understood by researchers and practitioners. Objective: The goal of our study is to provide a clear overview and characterization of the types of TD (both established and new ones) that appear in AI-based systems, as well as the antipatterns and related solutions that have been proposed. Method: Following the process of a systematic mapping study, 21 primary studies are identified and analyzed. Results: Our results show that (i) established TD types, variations of them, and four new TD types (data, model, configuration, and ethics debt) are present in AI-based systems, (ii) 72 antipatterns are discussed in the literature, the majority related to data and model deficiencies, and (iii) 46 solutions have been proposed, either to address specific TD types, antipatterns, or TD in general. Conclusions: Our results can support AI professionals with reasoning about and communicating aspects of TD present in their systems. Additionally, they can serve as a foundation for future research to further our understanding of TD in AI-based systems.

READ FULL TEXT
05/05/2021

Software Engineering for AI-Based Systems: A Survey

AI-based systems are software systems with functionalities enabled by at...
05/05/2022

Monitoring AI systems: A Problem Analysis, Framework and Outlook

Knowledge-based systems have been used to monitor machines and processes...
05/23/2021

Towards Knowledge Organization Ecosystems

It is needless to mention the (already established) overarching importan...
02/10/2021

Quality Assurance for AI-based Systems: Overview and Challenges

The number and importance of AI-based systems in all domains is growing....
07/21/2021

Audit, Don't Explain – Recommendations Based on a Socio-Technical Understanding of ML-Based Systems

In this position paper, I provide a socio-technical perspective on machi...
12/15/2020

A Systematic Mapping Study in AIOps

IT systems of today are becoming larger and more complex, rendering thei...