2022/03/15 by Rainer Bartoldus, Bartoldus, Rainer, Catrin Bernius +3 · 1 citation
Computer Science · Physics and Astronomy · #Advanced Data Storage Technologies #Computational Physics and Python Applications #FOS: Computer and information sciences #FOS: Electrical engineering #FOS: Physical sciences #High Energy Physics - Experiment (hep-ex) #Instrumentation and Detectors (physics.ins-det) #Machine Learning (cs.LG) #Particle Detector Development and Performance #Systems and Control (eess.SY) #electronic engineering #information engineering
paper · pdf · doi:10.48550/arxiv.2203.07620
openalex publication_date 2022/03/15 · openalex created_date 2022/04/03 · openalex updated_date 2026/07/28
Data-intensive physics facilities are increasingly reliant on heterogeneous and large-scale data processing and computational systems in order to collect, distribute, process, filter, and analyze the ever increasing huge volumes of data being collected. Moreover, these tasks are often performed in hard real-time or quasi real-time processing pipelines that place extreme constraints on various parameters and design choices for those systems. Consequently, a large number and variety of challenges are faced to design, construct, and operate such facilities. This is especially true at the energy and intensity frontiers of particle physics where bandwidths of raw data can exceed 100 TB/s of heterogeneous, high-dimensional data sourced from 300M+ individual sensors. Data filtering and compression algorithms deployed at these facilities often operate at the level of 1 part in 105, and once executed, these algorithms drive the data curation process, further highlighting the critical roles that these systems have in the physics impact of those endeavors. This White Paper aims to highlight the challenges that these facilities face in the design of the trigger and data acquisition instrumentation and systems, as well as in their installation, commissioning, integration and operation, and in building the domain knowledge and technical expertise required to do so.