DeepAI AI Chat
Log In Sign Up

Managing Machine Learning Workflow Components

by   Marcio Moreno, et al.

Machine Learning Workflows (MLWfs) have become essential and a disruptive approach in problem-solving over several industries. However, the development process of MLWfs may be complicated, hard to achieve, time-consuming, and error-prone. To handle this problem, in this paper, we introduce machine learning workflow management (MLWfM) as a technique to aid the development and reuse of MLWfs and their components through three aspects: representation, execution, and creation. More precisely, we discuss our approach to structure the MLWfs' components and their metadata to aid retrieval and reuse of components in new MLWfs. Also, we consider the execution of these components within a tool. The hybrid knowledge representation, called Hyperknowledge, frames our methodology, supporting the three MLWfM's aspects. To validate our approach, we show a practical use case in the Oil & Gas industry.


Designing for Recommending Intermediate States in A Scientific Workflow Management System

To process a large amount of data sequentially and systematically, prope...

How Developers Iterate on Machine Learning Workflows -- A Survey of the Applied Machine Learning Literature

Machine learning workflow development is anecdotally regarded to be an i...

Helix: Holistic Optimization for Accelerating Iterative Machine Learning

Machine learning workflow development is a process of trial-and-error: d...

A Machine-Learning-Aided Visual Analysis Workflow for Investigating Air Pollution Data

Analyzing air pollution data is challenging as there are various analysi...

Helix: Accelerating Human-in-the-loop Machine Learning

Data application developers and data scientists spend an inordinate amou...

In Defense of the Paper

The machine learning publication process is broken, of that there can be...

Enhancing Data Space Semantic Interoperability through Machine Learning: a Visionary Perspective

Our vision paper outlines a plan to improve the future of semantic inter...