Dynamic reconfiguration for malleable applications using RMA

2025/09/05 by Iker Martín Álvarez, Martín-Álvarez, Iker, José I. Aliaga +3 · 1 citation
Computer Science · #Distributed #Embedded Systems Design Techniques #FOS: Computer and information sciences #Parallel #and Cluster Computing (cs.DC)

paper · pdf · doi:10.48550/arxiv.2509.05248

openalex publication_date 2025/09/05 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

This paper investigates the novel one-sided communication methods based on remote memory access (RMA) operations in MPI for dynamic resizing of malleable applications, enabling data redistribution with minimal impact on application execution. After their integration into the MaM library, these methods are compared with traditional collective-based approaches. In addition, the existing strategy Wait Drains is extended to support efficient background reconfiguration. Results show comparable performance, though high initialization costs currently limit their advantage.

Citations

• Parallel Spawning Strategies for Dynamic-Aware MPI Applications
• Analyzing Resource Utilization in an HPC System: A Case Study of NERSC Perlmutter
• Extending SLURM for Dynamic Resource-Aware Adaptive Batch Scheduling

Cited by

• Parallel Spawning Strategies for Dynamic-Aware MPI Applications

Related

• Quo Vadis MPI RMA? Towards a More Efficient Use of MPI One-Sided Communication
• Parallel Spawning Strategies for Dynamic-Aware MPI Applications
• Resource Optimization with MPI Process Malleability for Dynamic Workloads in HPC Clusters
• Asynchronous progress design for a MPI-based PGAS one-sided communication system
• Seamless Execution of Malleable Applications in Controlled and Production HPC Environments