Providing Accessible Software Environments Across Science Gateways and HPC
Name
3626203.3670614.pdf
Size
581.57 KB
Format
Adobe PDF
Checksum (MD5)
58f598c4a7cf19e1cc8cf38b0dfd342e
Author(s)
Michels, Alexander
Kotak, Mit
Padmanabhan, Anand
Speaks, John
Wang, Shaowen
Date Issued
July 17, 2024
Publisher
ACM|Practice and Experience in Advanced Research Computing
Citation
Michels, Alexander, Kotak, Mit, Padmanabhan, Anand, Speaks, John and Wang, Shaowen. 2024. "Providing Accessible Software Environments Across Science Gateways and HPC."
Version
Final published version
Abstract
While High-Performance Computing (HPC) resources are powerful for tackling complex, computationally intensive analysis and modeling problems, access to these resources varies across disciplines. Domain scientists in a variety of fields such as social and environmental sciences often lack in-depth technical skills (e.g., familiarity with terminal, knowledge of job schedulers) to effectively utilize HPC resources, hindering desired research. In this context, CyberGIS-Compute is a middleware toolkit designed to democratize HPC access with the main goal of enabling domain scientists in diverse fields to solve computationally intensive problems. A key challenge facing model developers on CyberGIS-Compute is to create a containerized software environment for their models. Domain experts unfamiliar with HPC are generally unfamiliar with containerization technologies (e.g., Docker, Singularity) and thus unable to create/test containers to execute their models. But if they have access to science gateways, they would want to use these familiar software environments on HPC resources. This paper describes a novel approach to integrating the Cern Virtual Machine File System (CVMFS) into CyberGIS-Compute to provide consistent software environments across science gateways and HPC resources.
Description
PEARC ’24, July 21–25, 2024, Providence, RI, USA
MIT Department
Massachusetts Institute of Technology. Center for Computational Science and Engineering
Terms of Use
Creative Commons Attribution
Persistent DSpace Link
DOI of Published Version
https://doi.org/10.1145/3626203.3670614
