Workflow Provenance in the Lifecycle of Scientific Machine Learning

09/30/2020
by   Renan Souza, et al.
58

Machine Learning (ML) has already fundamentally changed several businesses. More recently, it has also been profoundly impacting the computational science and engineering domains, like geoscience, climate science, and health science. In these domains, users need to perform comprehensive data analyses combining scientific data and ML models to provide for critical requirements, such as reproducibility, model explainability, and experiment data understanding. However, scientific ML is multidisciplinary, heterogeneous, and affected by the physical constraints of the domain, making such analyses even more challenging. In this work, we leverage workflow provenance techniques to build a holistic view to support the lifecycle of scientific ML. We contribute with (i) characterization of the lifecycle and taxonomy for data analyses; (ii) design principles to build this view, with a W3C PROV compliant data representation and a reference system architecture; and (iii) lessons learned after an evaluation in an Oil Gas case using an HPC cluster with 393 nodes and 946 GPUs. The experiments show that the principles enable queries that integrate domain semantics with ML models while keeping low overhead (<1 scalability, and an order of magnitude of query acceleration under certain workloads against without our representation.

READ FULL TEXT

page 3

page 5

page 6

page 9

page 10

page 11

page 12

page 13

research
10/09/2019

Provenance Data in the Machine Learning Lifecycle in Computational Science and Engineering

Machine Learning (ML) has become essential in several industries. In Com...
research
06/22/2020

Machine Learning Pipelines: Provenance, Reproducibility and FAIR Data Principles

Machine learning (ML) is an increasingly important scientific tool suppo...
research
05/11/2021

Distributed In-memory Data Management for Workflow Executions

Complex scientific experiments from various domains are typically modele...
research
05/17/2019

Keeping Track of User Steering Actions in Dynamic Workflows

In long-lasting scientific workflow executions in HPC machines, computat...
research
09/22/2020

Semantic Workflows and Machine Learning for the Assessment of Carbon Storage by Urban Trees

Climate science is critical for understanding both the causes and conseq...
research
12/02/2021

A Hybrid Science-Guided Machine Learning Approach for Modeling and Optimizing Chemical Processes

This study presents a broad perspective of hybrid process modeling and o...
research
06/27/2023

CrunchGPT: A chatGPT assisted framework for scientific machine learning

Scientific Machine Learning (SciML) has advanced recently across many di...

Please sign up or login with your details

Forgot password? Click here to reset