Expanding IceCube GPU computing into the Clouds

07/08/2021
by   Igor Sfiligoi, et al.
0

The IceCube collaboration relies on GPU compute for many of its needs, including ray tracing simulation and machine learning activities. GPUs are however still a relatively scarce commodity in the scientific resource provider community, so we expanded the available resource pool with GPUs provisioned from the commercial Cloud providers. The provisioned resources were fully integrated into the normal IceCube workload management system through the Open Science Grid (OSG) infrastructure and used CloudBank for budget management. The result was an approximate doubling of GPU wall hours used by IceCube over a period of 2 weeks, adding over 3.1 fp32 EFLOP hours for a price tag of about 58k. This paper describes the setup used and the operational experience.

READ FULL TEXT
research
04/18/2020

Demonstrating a Pre-Exascale, Cost-Effective Multi-Cloud Environment for Scientific Computing

Scientific computing needs are growing dramatically with time and are ex...
research
02/16/2020

Running a Pre-Exascale, Geographically Distributed, Multi-Cloud Scientific Simulation

As we approach the Exascale era, it is important to verify that the exis...
research
10/25/2021

Data intensive physics analysis in Azure cloud

The Compact Muon Solenoid (CMS) experiment at the Large Hadron Collider ...
research
12/15/2022

Kernel-as-a-Service: A Serverless Interface to GPUs

Serverless computing has made it easier than ever to deploy applications...
research
05/18/2022

The anachronism of whole-GPU accounting

NVIDIA has been making steady progress in increasing the compute perform...
research
09/07/2019

Analyzing the HCP Datasets using GPUs: The Anatomy of a Science Engagement

This paper documents the experience improving the performance of a data ...

Please sign up or login with your details

Forgot password? Click here to reset