A description of the radio astronomy data processing tool DDF Pipeline

2025/09/03 by Mathis Certenais, Certenais, Mathis, François Bodin +3
Engineering · Physics and Astronomy · #Astronomy and Astrophysical Research #Distributed #FOS: Computer and information sciences #FOS: Physical sciences #Instrumentation and Methods for Astrophysics (astro-ph.IM) #Parallel #Radio Astronomy Observations and Technology #Space Technology and Applications #and Cluster Computing (cs.DC)

paper · pdf · doi:10.48550/arxiv.2509.03075

openalex publication_date 2025/09/03 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

This paper presents the DDF Pipeline, a radio astronomy data processing tool initially designed for the LOw-Frequency ARray (LO- FAR) radio-telescope and a candidate for processing data from the Square Kilometre Array (SKA). This work describes the DDF Pipeline software and presents a coarse-grain profiling execution to characterize its performance.

Citations

• Applying Wirtinger derivatives to the radio interferometry calibration problem

Related

• Africanus I. Scalable, distributed and efficient radio data processing with Dask-MS and Codex Africanus
• Adventures in Radio Astronomy Instrumentation and Signal Processing
• DALiuGE: A Graph Execution Framework for Harnessing the Astronomical Data Deluge
• Radio data archives round table
• A LOFAR RFI detection pipeline and its first results