Dynamo: Handling Scientific Data Across Sites and Storage Media
Author(s)
Iiyama, Yutaro; Maier, Benedikt; Abercrombie, Daniel; Goncharov, Maxim; Paus, Christoph
Download41781_2021_Article_54.pdf (3.295Mb)
Publisher with Creative Commons License
Publisher with Creative Commons License
Creative Commons Attribution
Terms of use
Metadata
Show full item recordAbstract
Abstract
Dynamo is a full-stack software solution for scientific data management. Dynamo’s architecture is modular, extensible, and customizable, making the software suitable for managing data in a wide range of installation scales, from a few terabytes stored at a single location to hundreds of petabytes distributed across a worldwide computing grid. This article documents the core system design of Dynamo and describes the applications that implement various data management tasks. A brief report is also given on the operational experiences of the system at the CMS experiment at the CERN Large Hadron Collider and at a small-scale analysis facility.
Date issued
2021-04-12Department
Massachusetts Institute of Technology. Laboratory for Nuclear SciencePublisher
Springer International Publishing
Citation
Computing and Software for Big Science. 2021 Apr 12;5(1):11
Version: Final published version