The Pipeline for the Continuous Development of Artificial Intelligence Models – Current State of Research and Practice

01/21/2023
by   Monika Steidl, et al.
0

Companies struggle to continuously develop and deploy AI models to complex production systems due to AI characteristics while assuring quality. To ease the development process, continuous pipelines for AI have become an active research area where consolidated and in-depth analysis regarding the terminology, triggers, tasks, and challenges is required. This paper includes a Multivocal Literature Review where we consolidated 151 relevant formal and informal sources. In addition, nine-semi structured interviews with participants from academia and industry verified and extended the obtained information. Based on these sources, this paper provides and compares terminologies for DevOps and CI/CD for AI, MLOps, (end-to-end) lifecycle management, and CD4ML. Furthermore, the paper provides an aggregated list of potential triggers for reiterating the pipeline, such as alert systems or schedules. In addition, this work uses a taxonomy creation strategy to present a consolidated pipeline comprising tasks regarding the continuous development of AI. This pipeline consists of four stages: Data Handling, Model Learning, Software Development and System Operations. Moreover, we map challenges regarding pipeline implementation, adaption, and usage for the continuous development of AI to these four stages.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/16/2023

Artificial Intelligence for Technical Debt Management in Software Development

Technical debt is a well-known challenge in software development, and it...
research
08/30/2021

An Artificial Intelligence Life Cycle: From Conception to Production

Drawing on our experience of more than a decade of AI in academic resear...
research
06/28/2019

Implementing Ethics in AI: An industrial multiple case study

Solutions in artificial intelligence (AI) are becoming increasingly wide...
research
11/01/2022

Strategies for Optimizing End-to-End Artificial Intelligence Pipelines on Intel Xeon Processors

End-to-end (E2E) artificial intelligence (AI) pipelines are composed of ...
research
08/02/2023

DeepSpeed-Chat: Easy, Fast and Affordable RLHF Training of ChatGPT-like Models at All Scales

ChatGPT-like models have revolutionized various applications in artifici...
research
11/20/2019

Hard Choices in Artificial Intelligence: Addressing Normative Uncertainty through Sociotechnical Commitments

As AI systems become prevalent in high stakes domains such as surveillan...
research
01/15/2019

AI Pipeline - bringing AI to you. End-to-end integration of data, algorithms and deployment tools

Next generation of embedded Information and Communication Technology (IC...

Please sign up or login with your details

Forgot password? Click here to reset