2022/12/02 by Caspar Schmitt, Schmitt, Caspar, Yu, Boyang +1
Computer Science · Decision Sciences · #Advanced Data Storage Technologies #Data Analysis #Distributed and Parallel Computing Systems #FOS: Physical sciences #High Energy Physics - Experiment (hep-ex) #Scientific Computing and Data Management #Statistics and Probability (physics.data-an)
paper · pdf · doi:10.48550/arxiv.2212.01422
openalex publication_date 2022/12/02 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28
A workflow describes the entirety of processing steps in an analysis, such as employed in many fields of physics. Workflow management makes the dependencies between individual steps of a workflow and their computational requirements explicit, such that entire workflows can be executed in a stand-alone manner. Though the use of workflow management is widely recommended in the interest of transparency, reproducibility and data preservation, choosing among the large variety of available workflow management tools can be overwhelming. We compare selected workflow management tools concerning all relevant criteria and make recommendations for different use cases.