Managing Machine Learning Workflow Components

12/10/2019
by   Marcio Moreno, et al.
0

Machine Learning Workflows (MLWfs) have become essential and a disruptive approach in problem-solving over several industries. However, the development process of MLWfs may be complicated, hard to achieve, time-consuming, and error-prone. To handle this problem, in this paper, we introduce machine learning workflow management (MLWfM) as a technique to aid the development and reuse of MLWfs and their components through three aspects: representation, execution, and creation. More precisely, we discuss our approach to structure the MLWfs' components and their metadata to aid retrieval and reuse of components in new MLWfs. Also, we consider the execution of these components within a tool. The hybrid knowledge representation, called Hyperknowledge, frames our methodology, supporting the three MLWfM's aspects. To validate our approach, we show a practical use case in the Oil & Gas industry.

READ FULL TEXT
research
10/10/2020

Designing for Recommending Intermediate States in A Scientific Workflow Management System

To process a large amount of data sequentially and systematically, prope...
research
03/27/2018

How Developers Iterate on Machine Learning Workflows -- A Survey of the Applied Machine Learning Literature

Machine learning workflow development is anecdotally regarded to be an i...
research
12/14/2018

Helix: Holistic Optimization for Accelerating Iterative Machine Learning

Machine learning workflow development is a process of trial-and-error: d...
research
02/11/2022

A Machine-Learning-Aided Visual Analysis Workflow for Investigating Air Pollution Data

Analyzing air pollution data is challenging as there are various analysi...
research
08/21/2023

Geo-Sketcher: Rapid 3D Geological Modeling using Geological and Topographic Map Sketches

The construction of 3D geological models is an essential task in oil/gas...
research
04/16/2021

In Defense of the Paper

The machine learning publication process is broken, of that there can be...
research
03/15/2023

Enhancing Data Space Semantic Interoperability through Machine Learning: a Visionary Perspective

Our vision paper outlines a plan to improve the future of semantic inter...

Please sign up or login with your details

Forgot password? Click here to reset