Docker-Enabled Build and Execution Environment (BEE): an Encapsulated Environment Enabling HPC Applications Running Everywhere

12/19/2017
by   Jieyang Chen, et al.
0

Variations in High Performance Computing (HPC) system software configurations mean that applications are typically configured and built for specific HPC environments. Building applications can require a significant investment of time and effort for application users and requires application users to have additional technical knowledge. Container technologies like Docker bring great benefits to the application development, build and deployment processes. While much cloud computing infrastructure is already designed to support Docker, little work has been done to support production Docker deployment on HPC systems. In this work, we propose a Docker-enabled Build and Execution Environment (BEE) for HPC systems and detail a standard backend for BEE using virtual machines, the BEE-VM. This brings many of the benefits of Docker to existing HPC machines in user-space without the requirement of specialized pre-installed software and with no system administrator configuration. We show that current HPC application can be easily configured to run within BEE, eliminating the need to reconfigure and rebuild applications for different systems while preserving comparable performance.

READ FULL TEXT
research
08/01/2018

Container solutions for HPC Systems: A Case Study of Using Shifter on Blue Waters

Software container solutions have revolutionized application development...
research
04/15/2021

Minimizing privilege for building HPC containers

HPC centers face increasing demand for software flexibility, and there i...
research
07/29/2019

Staged deployment of interactive multi-application HPC workflows

Running scientific workflows on a supercomputer can be a daunting task f...
research
12/11/2019

High Performance Computing for Geospatial Applications: A Retrospective View

Many types of geospatial analyses are computationally complex, involving...
research
01/12/2018

Effect of Meltdown and Spectre Patches on the Performance of HPC Applications

In this work we examine how the updates addressing Meltdown and Spectre ...
research
10/23/2018

LincoSim: a web based HPC-cloud platform for automatic virtual towing tank analysis

In this work, we present a new web based HPC-cloud platform for automati...
research
03/25/2022

Aspect-Oriented Programming based building block platform to construct Domain-Specific Language for HPC application

The world of HPC systems is changing to a more complicated system becaus...

Please sign up or login with your details

Forgot password? Click here to reset