Asynchronous MPI for the Masses

2013/02/18 by Markus Wittmann, Georg Hager, Wittmann, Markus +5 · 1 citation
Computer Science · #Advanced Data Storage Technologies #Distributed #FOS: Computer and information sciences #Interconnection Networks and Systems #Parallel #Parallel Computing and Optimization Techniques #Performance (cs.PF) #and Cluster Computing (cs.DC)

paper · pdf · doi:10.48550/arxiv.1302.4280

openalex publication_date 2013/02/18 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

We present a simple library which equips MPI implementations with truly asynchronous non-blocking point-to-point operations, and which is independent of the underlying communication infrastructure. It utilizes the MPI profiling interface (PMPI) and the MPI_THREAD_MULTIPLE thread compatibility level, and works with current versions of Intel MPI, Open MPI, MPICH2, MVAPICH2, Cray MPI, and IBM MPI. We show performance comparisons on a commodity InfiniBand cluster and two tier-1 systems in Germany, using low-level and application benchmarks. Issues of thread/process placement and the peculiarities of different MPI implementations are discussed in detail. We also identify the MPI libraries that already support asynchronous operations. Finally we show how our ideas can be extended to MPI-IO.

Cited by

• A high-level characterisation and generalisation of communication-avoiding programming techniques

Related

• MPI Benchmarking Revisited: Experimental Design and Reproducibility
• Some New Approaches to MPI Implementations
• Examining MPI and its Extensions for Asynchronous Multithreaded Communication
• Lessons Learned on MPI+Threads Communication
• Learning from the Success of MPI