Using ATLAS@Home to exploit extra CPU from busy grid sites

11/29/2018
by   Wenjing Wu, et al.
0

Grid computing typically provides most of the data processing resources for large High Energy Physics experiments. However typical grid sites are not fully utilized by regular workloads. In order to increase the CPU utilization of these grid sites, the ATLAS@Home volunteer computing framework can be used as a backfilling mechanism. Results show an extra 15 exploited by backfilling grid sites running regular workloads while the overall CPU utilization can remain over 90 rate of the grid jobs, and the impact on the CPU efficiency of grid jobs varies from 1 throughput of backfill jobs in terms of CPU time per simulated event is the same as for resources dedicated to ATLAS@Home. This approach is sufficiently generic that it can easily be extended to other clusters.

READ FULL TEXT
research
03/16/2022

Evolution of HEP Processing Frameworks

HEP data-processing software must support the disparate physics needs of...
research
11/30/2020

Adapting LIGO workflows to run in the Open Science Grid

During the first observation run the LIGO collaboration needed to offloa...
research
02/26/2019

Simulating Data Access Profiles of Computational Jobs in Data Grids

The data access patterns of applications running in computing grids are ...
research
01/21/2013

Pattern Matching for Self- Tuning of MapReduce Jobs

In this paper, we study CPU utilization time patterns of several MapRedu...
research
04/16/2017

A Security Monitoring Framework For Virtualization Based HEP Infrastructures

High Energy Physics (HEP) distributed computing infrastructures require ...
research
03/01/2022

Tiny Autoscalers for Tiny Workloads: Dynamic CPU Allocation for Serverless Functions

In serverless computing, applications are executed under lightweight vir...
research
04/20/2017

Intrusion Prevention and Detection in Grid Computing - The ALICE Case

Grids allow users flexible on-demand usage of computing resources throug...

Please sign up or login with your details

Forgot password? Click here to reset