Application of Systems Engineering Process in Building ML-Enabled Systems

08/10/2023
by   Jie JW Wu, et al.
0

Machine learning (ML) components are being added to more and more critical and impactful software systems, but the software development process of real-world production systems from prototyped ML models remains challenging with additional complexity and interdisciplinary collaboration challenges. This poses difficulties in using traditional software lifecycle models such as waterfall, spiral or agile model when building ML-enabled systems. By interviewing with practitioners from multiple companies, we investigated the application of using systems engineering process in ML-enabled systems. We developed a set of propositions and proposed V4ML process model for building products with ML components. We found that V4ML process model requires more efforts on documentation, system decomposition and V V, but it addressed the interdisciplinary collaboration challenges and additional complexity introduced by ML components.

READ FULL TEXT
research
10/19/2021

Collaboration Challenges in Building ML-Enabled Systems: Communication, Documentation, Engineering, and Process

The introduction of machine learning (ML) components in software project...
research
01/10/2023

Understanding the Complexity and Its Impact on Testing in ML-Enabled Systems

Machine learning (ML) enabled systems are emerging with recent breakthro...
research
09/30/2022

Empowering the trustworthiness of ML-based critical systems through engineering activities

This paper reviews the entire engineering process of trustworthy Machine...
research
01/31/2023

An investigation of challenges encountered when specifying training data and runtime monitors for safety critical ML applications

Context and motivation: The development and operation of critical softwa...
research
11/23/2020

Resonance: Replacing Software Constants with Context-Aware Models in Real-time Communication

Large software systems tune hundreds of 'constants' to optimize their ru...
research
05/26/2021

An Empirical Study of Software Architecture for Machine Learning

Specific developmental and operational characteristics of machine learni...
research
03/31/2023

A Meta-Summary of Challenges in Building Products with ML Components – Collecting Experiences from 4758+ Practitioners

Incorporating machine learning (ML) components into software products ra...

Please sign up or login with your details

Forgot password? Click here to reset