Towards an Approximation-Aware Computational Workflow Framework for Accelerating Large-Scale Discovery Tasks

06/13/2022
by   Michael A. Johnston, et al.
0

The use of approximation is fundamental in computational science. Almost all computational methods adopt approximations in some form in order to obtain a favourable cost/accuracy trade-off and there are usually many approximations that could be used. As a result, when a researcher wishes to measure a property of a system with a computational technique, they are faced with an array of options. Current computational workflow frameworks focus on helping researchers automate a sequence of steps on a particular platform. The aim is often to obtain a computational measurement of a property. However these frameworks are unaware that there may be a large number of ways to do so. As such, they cannot support researchers in making these choices during development or at execution-time. We argue that computational workflow frameworks should be designed to be approximation-aware - that is, support the fact that a given workflow description represents a task that could be performed in different ways. This is key to unlocking the potential of computational workflows to accelerate discovery tasks, particularly those involving searches of large entity spaces. It will enable efficiently obtaining measurements of entity properties, given a set of constraints, by directly leveraging the space of choices available. In this paper we describe the basic functions that an approximation-aware workflow framework should provide, how those functions can be realized in practice, and illustrate some of the powerful capabilities it would enable, including approximate memoization, surrogate model support, and automated workflow composition.

READ FULL TEXT
research
06/02/2020

Workflow-as-a-Service Cloud Platform and Deployment of Bioinformatics Workflow Applications

Workflow management systems (WMS) support the composition and deployment...
research
04/09/2023

AI-assisted Automated Workflow for Real-time X-ray Ptychography Data Analysis via Federated Resources

We present an end-to-end automated workflow that uses large-scale remote...
research
01/10/2021

An Empirical Study on Serverless Workflow Service

Along with the wide-adoption of Serverless Computing, more and more appl...
research
01/19/2022

Workflows Community Summit: Tightening the Integration between Computing Facilities and Scientific Workflows

The importance of workflows is highlighted by the fact that they have un...
research
04/15/2019

Bounded and Approximate Strong Satisfiability in Workflows

There has been a considerable amount of interest in recent years in the ...
research
09/12/2022

BottleMod: Modeling Data Flows and Tasks for Fast Bottleneck Analysis

In the recent years, scientific workflows gained more and more popularit...
research
09/08/2023

The State of Disappearing Frameworks in 2023

Disappearing frameworks represent a new type of thinking for web develop...

Please sign up or login with your details

Forgot password? Click here to reset