2018/01/22 by Florian Spenke, Karsten Balzer, Spenke, Florian +7
Computer Science · #65Y05 #68Q10 #68W10 #68W15 #Chemical Physics (physics.chem-ph) #Cloud Computing and Resource Management #Computational Physics (physics.comp-ph) #Distributed #Distributed and Parallel Computing Systems #FOS: Computer and information sciences #FOS: Physical sciences #Parallel #Parallel Computing and Optimization Techniques #and Cluster Computing (cs.DC)
paper · pdf · doi:10.48550/arxiv.1801.07184
openalex publication_date 2018/01/22 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28
In practice, standard scheduling of parallel computing jobs almost always leaves significant portions of the available hardware unused, even with many jobs still waiting in the queue. The simple reason is that the resource requests of these waiting jobs are fixed and do not match the available, unused resources. However, with alternative but existing and well-established techniques it is possible to achieve a fully automated, adaptive parallelism that does not need pre-set, fixed resources. Here, we demonstrate that such an adaptively parallel program can indeed fill in all such scheduling gaps, even in real-life situations on large supercomputers.