Analysis of Software Engineering for Agile Machine Learning Projects

12/16/2019
by   Kushal Singla, et al.
0

The number of machine learning, artificial intelligence or data science related software engineering projects using Agile methodology is increasing. However, there are very few studies on how such projects work in practice. In this paper, we analyze project issues tracking data taken from Scrum (a popular tool for Agile) for several machine learning projects. We compare this data with corresponding data from non-machine learning projects, in an attempt to analyze how machine learning projects are executed differently from normal software engineering projects. On analysis, we find that machine learning project issues use different kinds of words to describe issues, have higher number of exploratory or research oriented tasks as compared to implementation tasks, and have a higher number of issues in the product backlog after each sprint, denoting that it is more difficult to estimate the duration of machine learning project related tasks in advance. After analyzing this data, we propose a few ways in which Agile machine learning projects can be better logged and executed, given their differences with normal software engineering projects.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 2

11/30/2017

Agile Software Engineering and Systems Engineering at SKA Scale

Systems Engineering (SE) is the set of processes and documentation requi...
02/06/2020

A Dataset for GitHub Repository Deduplication

GitHub projects can be easily replicated through the site's fork process...
03/09/2021

Software Development During COVID-19 Pandemic: an Analysis of Stack Overflow and GitHub

The new coronavirus became a severe health issue for the world. This sit...
07/03/2018

Implementing SCRUM to develop a connected robot

Agile methods are receiving a growing interest from industry and these a...
10/06/2011

Discovering patterns of correlation and similarities in software project data with the Circos visualization tool

Software cost estimation based on multivariate data from completed proje...
01/25/2018

Agile development for vulnerable populations: lessons learned and recommendations

In this paper we draw attention to the challenges of managing software p...
09/20/2017

Achieving CMMI Level 2 with Enhanced Extreme Programming Approach

The relationship between agile methods and Software Engineering Institut...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.