Repository logo
Log in(current)
Repository logoMIT Open ScholarshipDSpace@MIT
  1. Home
  2. MIT Open Access Articles
  3. MIT Open Access Articles
  4. Dynamic Distribution of High-Rate Data Processing from CERN to Remote HPC Data Centers

Dynamic Distribution of High-Rate Data Processing from CERN to Remote HPC Data Centers

Thumbnail Image
Download
Name

41781_2020_Article_52.pdf

Size

1008.53 KB

Format

Adobe PDF

Checksum (MD5)

b8d6af0ad0d8774fb1af17ceb600694d

Download all files submitted through automated deposit
art_5086649794207937209.zip (784.04 KB)
Author(s)
Boccali, T.
•
Cameron, D.
•
Cardo, N.
•
Conciatore, D.
•
Di Girolamo, A.
•
Dissertori, G.
•
Fernandez, P.
•
Filipcic, A.
•
Gila, M.
•
Grab, C.
more
Date Issued
February 8, 2021
Publisher
Springer International Publishing
Citation
Computing and Software for Big Science. 2021 Feb 08;5(1):7
Version
Final published version
Abstract
Abstract The prompt reconstruction of the data recorded from the Large Hadron Collider (LHC) detectors has always been addressed by dedicated resources at the CERN Tier-0. Such workloads come in spikes due to the nature of the operation of the accelerator and in special high load occasions experiments have commissioned methods to distribute (spill-over) a fraction of the load to sites outside CERN. The present work demonstrates a new way of supporting the Tier-0 environment by provisioning resources elastically for such spilled-over workflows onto the Piz Daint Supercomputer at CSCS. This is implemented using containers, tuning the existing batch scheduler and reinforcing the scratch file system, while still using standard Grid middleware. ATLAS, CMS and CSCS have jointly run selected prompt data reconstruction on up to several thousand cores on Piz Daint into a shared environment, thereby probing the viability of the CSCS high performance computer site as on demand extension of the CERN Tier-0, which could play a role in addressing the future LHC computing challenges for the high luminosity LHC.
MIT Department
Massachusetts Institute of Technology. Department of Physics
Terms of Use
Creative Commons Attribution
https://creativecommons.org/licenses/by/4.0/
Persistent DSpace Link
https://hdl.handle.net/1721.1/131966
DOI of Published Version
https://doi.org/10.1007/s41781-020-00052-w
Repository logo
PrivacyPermissionsAccessibilityContact us
Repository logo
Notify us about copyright concerns.