Bringing AI pipelines onto cloud-HPC: setting a baseline for accuracy of COVID-19 AI diagnosis

08/02/2021
by   Iacopo Colonnelli, et al.
0

HPC is an enabling platform for AI. The introduction of AI workloads in the HPC applications basket has non-trivial consequences both on the way of designing AI applications and on the way of providing HPC computing. This is the leitmotif of the convergence between HPC and AI. The formalized definition of AI pipelines is one of the milestones of HPC-AI convergence. If well conducted, it allows, on the one hand, to obtain portable and scalable applications. On the other hand, it is crucial for the reproducibility of scientific pipelines. In this work, we advocate the StreamFlow Workflow Management System as a crucial ingredient to define a parametric pipeline, called "CLAIRE COVID-19 Universal Pipeline," which is able to explore the optimization space of methods to classify COVID-19 lung lesions from CT scans, compare them for accuracy, and therefore set a performance baseline. The universal pipeline automatizes the training of many different Deep Neural Networks (DNNs) and many different hyperparameters. It, therefore, requires a massive computing power, which is found in traditional HPC infrastructure thanks to the portability-by-design of pipelines designed with StreamFlow. Using the universal pipeline, we identified a DNN reaching over 90 detecting COVID-19 lesions in CT scans.

READ FULL TEXT

page 3

page 5

research
08/24/2022

AI-coupled HPC Workflows

Increasingly, scientific discovery requires sophisticated and scalable w...
research
01/28/2021

An Explainable AI System for Automated COVID-19 Assessment and Lesion Categorization from CT-scans

COVID-19 infection caused by SARS-CoV-2 pathogen is a catastrophic pande...
research
08/26/2020

Optimising AI Training Deployments using Graph Compilers and Containers

Artificial Intelligence (AI) applications based on Deep Neural Networks ...
research
12/07/2022

SAIH: A Scalable Evaluation Methodology for Understanding AI Performance Trend on HPC Systems

Novel artificial intelligence (AI) technology has expedited various scie...
research
09/08/2020

Label-Free Segmentation of COVID-19 Lesions in Lung CT

Scarcity of annotated images hampers the building of automated solution ...
research
07/31/2023

LEONARDO: A Pan-European Pre-Exascale Supercomputer for HPC and AI Applications

A new pre-exascale computer cluster has been designed to foster scientif...
research
10/20/2020

Scalable HPC and AI Infrastructure for COVID-19 Therapeutics

COVID-19 has claimed more 1 million lives and resulted in over 40 millio...

Please sign up or login with your details

Forgot password? Click here to reset