Analysis of Software Engineering for Agile Machine Learning Projects

by   Kushal Singla, et al.

The number of machine learning, artificial intelligence or data science related software engineering projects using Agile methodology is increasing. However, there are very few studies on how such projects work in practice. In this paper, we analyze project issues tracking data taken from Scrum (a popular tool for Agile) for several machine learning projects. We compare this data with corresponding data from non-machine learning projects, in an attempt to analyze how machine learning projects are executed differently from normal software engineering projects. On analysis, we find that machine learning project issues use different kinds of words to describe issues, have higher number of exploratory or research oriented tasks as compared to implementation tasks, and have a higher number of issues in the product backlog after each sprint, denoting that it is more difficult to estimate the duration of machine learning project related tasks in advance. After analyzing this data, we propose a few ways in which Agile machine learning projects can be better logged and executed, given their differences with normal software engineering projects.



There are no comments yet.


page 2


Agile Software Engineering and Systems Engineering at SKA Scale

Systems Engineering (SE) is the set of processes and documentation requi...

A Dataset for GitHub Repository Deduplication

GitHub projects can be easily replicated through the site's fork process...

Software Development During COVID-19 Pandemic: an Analysis of Stack Overflow and GitHub

The new coronavirus became a severe health issue for the world. This sit...

Implementing SCRUM to develop a connected robot

Agile methods are receiving a growing interest from industry and these a...

Discovering patterns of correlation and similarities in software project data with the Circos visualization tool

Software cost estimation based on multivariate data from completed proje...

Agile development for vulnerable populations: lessons learned and recommendations

In this paper we draw attention to the challenges of managing software p...

Achieving CMMI Level 2 with Enhanced Extreme Programming Approach

The relationship between agile methods and Software Engineering Institut...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.