Speeding up charge exchange recombination spectroscopy analysis in support of NERSC/DIII-D realtime workflow

09/15/2023
by   Aarushi Jain, et al.
0

We report optimization work made in support of the development of a realtime Superfacility workflow between DIII-D and NERSC. At DIII-D, the ion properties measured by charge exchange recombination (CER) spectroscopy are required inputs for a Superfacility realtime workflow that computes the full plasma kinetic equilibrium. In this workflow, minutes matter since the results must be ready during the brief 10-15 minute pause between plasma discharges. Prior to this work, a sample CERFIT analysis took approximately 15 minutes. Because the problem consists of many calculations that can be done independently, we were able to restructure the CERFIT code to leverage this parallelism with Slurm job arrays. We reduced the runtime to approximately 51 seconds – a speedup of roughly 20x, saving valuable time for both the scientists interested in the CER results and also for the larger equilibrium reconstruction workflow.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/17/2022

Macaw: The Machine Learning Magnetometer Calibration Workflow

In Earth Systems Science, many complex data pipelines combine different ...
research
01/04/2023

Towards a Unified User Interface for Visual Analysis of Retinal Data in Ophthalmology

The visual analysis of retinal data contributes to the understanding of ...
research
07/25/2018

Validation and Inference of Schema-Level Workflow Data-Dependency Annotations

An advantage of scientific workflow systems is their ability to collect ...
research
05/28/2019

MolSSI and BioExcel Workflow Workshop 2018 Report

Workflows in biomolecular science are very important as they are intrica...
research
03/05/2019

Implementing Microservices through Microtasks

Microtask programming is a form of crowdsourcing for programming in whic...
research
10/21/2021

Three Practical Workflow Schedulers for Easy Maximum Parallelism

Runtime scheduling and workflow systems are an increasingly popular algo...
research
05/04/2023

Notes on Refactoring Exponential Macros in Common Lisp

I recently consulted for a very big Common Lisp project having more than...

Please sign up or login with your details

Forgot password? Click here to reset