Learning Everywhere: Pervasive Machine Learning for Effective High-Performance Computation

02/27/2019
by   Geoffrey Fox, et al.
0

The convergence of HPC and data-intensive methodologies provide a promising approach to major performance improvements. This paper provides a general description of the interaction between traditional HPC and ML approaches and motivates the Learning Everywhere paradigm for HPC. We introduce the concept of effective performance that one can achieve by combining learning methodologies with simulation-based approaches, and distinguish between traditional performance as measured by benchmark scores. To support the promise of integrating HPC and learning methods, this paper examines specific examples and opportunities across a series of domains. It concludes with a series of open computer science and cyberinfrastructure questions and challenges that the Learning Everywhere paradigm presents.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/05/2019

Understanding ML driven HPC: Applications and Infrastructure

We recently outlined the vision of "Learning Everywhere" which captures ...
research
11/23/2020

Integrating Deep Learning in Domain Sciences at Exascale

This paper presents some of the current challenges in designing deep lea...
research
05/16/2018

A Software-Defined QoS Provisioning Framework for HPC Applications

With the emergence of large-scale data-intensive high-performance applic...
research
08/24/2022

AI-coupled HPC Workflows

Increasingly, scientific discovery requires sophisticated and scalable w...
research
08/24/2020

Integrating Machine Learning with HPC-driven Simulations for Enhanced Student Learning

We explore the idea of integrating machine learning (ML) with high perfo...
research
05/28/2022

HPC Extensions to the OpenKIM Processing Pipeline

The Open Knowledgebase of Interatomic Models (OpenKIM) is an NSF Science...
research
05/19/2022

Prediction for Distributional Outcomes in High-Performance Computing I/O Variability

Although high-performance computing (HPC) systems have been scaled to me...

Please sign up or login with your details

Forgot password? Click here to reset