Workflows to driving high-performance interactive supercomputing for urgent decision making

06/28/2022
by   Nick Brown, et al.
0

Interactive urgent computing is a small but growing user of supercomputing resources. However there are numerous technical challenges that must be overcome to make supercomputers fully suited to the wide range of urgent workloads which could benefit from the computational power delivered by such instruments. An important question is how to connect the different components of an urgent workload; namely the users, the simulation codes, and external data sources, together in a structured and accessible manner. In this paper we explore the role of workflows from both the perspective of marshalling and control of urgent workloads, and at the individual HPC machine level. Ultimately requiring two workflow systems, by using a space weather prediction urgent use-cases, we explore the benefit that these two workflow systems provide especially when one exploits the flexibility enabled by them interoperating.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/27/2020

EdgeBench: A Workflow-based Benchmark for Edge Computing

Edge computing has been developed to utilize multiple tiers of resources...
research
08/01/2018

Container solutions for HPC Systems: A Case Study of Using Shifter on Blue Waters

Software container solutions have revolutionized application development...
research
10/17/2020

The role of interactive super-computing in using HPC for urgent decision making

Technological advances are creating exciting new opportunities that have...
research
07/29/2019

Staged deployment of interactive multi-application HPC workflows

Running scientific workflows on a supercomputer can be a daunting task f...
research
09/05/2020

Unleashing In-network Computing on Scientific Workloads

Many recent efforts have shown that in-network computing can benefit var...
research
12/09/2021

Is Disaggregation possible for HPC Cognitive Simulation?

Cognitive simulation (CogSim) is an important and emerging workflow for ...
research
02/20/2006

Methods for scaling a large member base

The technical challenges of scaling websites with large and growing memb...

Please sign up or login with your details

Forgot password? Click here to reset