vix.ing · top · new · best · stats · spec

Automatic Metadata Capture and Processing for High-Performance Workflows

2025/06/18 by Polina Shpilker, Shpilker, Polina, Line Pouchard +1
Computer Science · Decision Sciences · #Advanced Database Systems and Queries #Distributed #FOS: Computer and information sciences #Parallel #Scientific Computing and Data Management #Semantic Web and Ontologies #and Cluster Computing (cs.DC)

paper · pdf · doi:10.48550/arxiv.2506.15537

openalex publication_date 2025/06/18 · openalex created_date 2025/10/19 · openalex updated_date 2026/08/01

Abstract

Modern workflows run on increasingly heterogeneous computing architectures and with this heterogeneity comes additional complexity. We aim to apply the FAIR principles for research reproducibility by developing software to collect metadata annotations for workflows run on HPC systems. We experiment with two possible formats to uniformly store these metadata, and reorganize the collected metadata to be as easy to use as possible for researchers studying their workflow performance.

Citations

Related