A Preliminary Investigation of MLOps Practices in GitHub

09/23/2022
by   Fabio Calefato, et al.
0

Background. The rapid and growing popularity of machine learning (ML) applications has led to an increasing interest in MLOps, that is, the practice of continuous integration and deployment (CI/CD) of ML-enabled systems. Aims. Since changes may affect not only the code but also the ML model parameters and the data themselves, the automation of traditional CI/CD needs to be extended to manage model retraining in production. Method. In this paper, we present an initial investigation of the MLOps practices implemented in a set of ML-enabled systems retrieved from GitHub, focusing on GitHub Actions and CML, two solutions to automate the development workflow. Results. Our preliminary results suggest that the adoption of MLOps workflows in open-source GitHub projects is currently rather limited. Conclusions. Issues are also identified, which can guide future research work.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/08/2023

A Dataset and Analysis of Open-Source Machine Learning Products

Machine learning (ML) components are increasingly incorporated into soft...
research
03/06/2021

On the experiences of adopting automated data validation in an industrial machine learning project

Background: Data errors are a common challenge in machine learning (ML) ...
research
03/01/2021

Practices for Engineering Trustworthy Machine Learning Applications

Following the recent surge in adoption of machine learning (ML), the neg...
research
04/16/2018

Accelerating Human-in-the-loop Machine Learning: Challenges and Opportunities

Development of machine learning (ML) workflows is a tedious process of i...
research
07/20/2023

Assessing the Use of AutoML for Data-Driven Software Engineering

Background. Due to the widespread adoption of Artificial Intelligence (A...
research
03/07/2023

Developers' Perception of GitHub Actions: A Survey Analysis

GitHub introduced "Actions" in 2019 to increase workflow velocity and ad...
research
07/27/2023

On the Suitability of Hugging Face Hub for Empirical Studies

Background. The development of empirical studies in software engineering...

Please sign up or login with your details

Forgot password? Click here to reset