DeepAI AI Chat
Log In Sign Up

Deep-learning enhancement of large scale numerical simulations

by   Caspar van Leeuwen, et al.

Traditional simulations on High-Performance Computing (HPC) systems typically involve modeling very large domains and/or very complex equations. HPC systems allow running large models, but limits in performance increase that have become more prominent in the last 5-10 years will likely be experienced. Therefore new approaches are needed to increase application performance. Deep learning appears to be a promising way to achieve this. Recently deep learning has been employed to enhance solving problems that traditionally are solved with large-scale numerical simulations using HPC. This type of application, deep learning for high-performance computing, is the theme of this whitepaper. Our goal is to provide concrete guidelines to scientists and others that would like to explore opportunities for applying deep learning approaches in their own large-scale numerical simulations. These guidelines have been extracted from a number of experiments that have been undertaken in various scientific domains over the last two years, and which are described in more detail in the Appendix. Additionally, we share the most important lessons that we have learned.


page 3

page 16

page 17

page 20

page 22

page 24

page 33

page 34


The Petascale DTN Project: High Performance Data Transfer for HPC Facilities

The movement of large-scale (tens of Terabytes and larger) data sets bet...

Exploring hyper-parameter spaces of neuroscience models on high performance computers with Learning to Learn

Neuroscience models commonly have a high number of degrees of freedom an...

Integrating Deep Learning in Domain Sciences at Exascale

This paper presents some of the current challenges in designing deep lea...

Steady-State Control and Machine Learning of Large-Scale Deformable Mirror Models

We use Machine Learning (ML) and system identification validation approa...

An In-Depth Analysis of the Slingshot Interconnect

The interconnect is one of the most critical components in large scale c...

Shall numerical astrophysics step into the era of Exascale computing?

High performance computing numerical simulations are today one of the mo...

Reinventing High Performance Computing: Challenges and Opportunities

The world of computing is in rapid transition, now dominated by a world ...