vix.ing · top · new · best · stats · spec

Understanding ML driven HPC: Applications and Infrastructure

2019/09/05 by Geoffrey Fox, Fox, Geoffrey, Shantenu Jha +1
Computer Science · Decision Sciences · #Computational Physics (physics.comp-ph) #Distributed #Distributed and Parallel Computing Systems #FOS: Computer and information sciences #FOS: Physical sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Neural Networks and Applications #Parallel #Scientific Computing and Data Management #and Cluster Computing (cs.DC)

paper · pdf · doi:10.48550/arxiv.1909.02363

openalex publication_date 2019/09/05 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

We recently outlined the vision of "Learning Everywhere" which captures the possibility and impact of how learning methods and traditional HPC methods can be coupled together. A primary driver of such coupling is the promise that Machine Learning (ML) will give major performance improvements for traditional HPC simulations. Motivated by this potential, the ML around HPC class of integration is of particular significance. In a related follow-up paper, we provided an initial taxonomy for integrating learning around HPC methods. In this paper, which is part of the Learning Everywhere series, we discuss "how" learning methods and HPC simulations are being integrated to enhance effective performance of computations. This paper identifies several modes --- substitution, assimilation, and control, in which learning methods integrate with HPC simulations and provide representative applications in each mode. This paper discusses some open research questions and we hope will motivate and clear the ground for MLaroundHPC benchmarks.

Citations

Related