vix.ing · top · new · best · stats · spec

Streaming supercomputing needs workflow-enabled programming-in-the-large

2017/02/24 by Justin M. Wozniak, Jonathan Ozik, Wozniak, Justin M +5
Computer Science · Decision Sciences · #Cloud Computing and Resource Management #Data Stream Mining Techniques #Distributed #FOS: Computer and information sciences #Parallel #Scientific Computing and Data Management #and Cluster Computing (cs.DC)

paper · pdf · doi:10.48550/arxiv.1702.07425

openalex publication_date 2017/02/24 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

This is a position paper, submitted to the Future Online Analysis Platform Workshop (https://press3.mcs.anl.gov/futureplatform/), which argues that simple data analysis applications are common today, but future online supercomputing workloads will need to couple multiple advanced technologies (streams, caches, analysis, and simulations) to rapidly deliver scientific results. Each of these technologies are active research areas when integrated with high-performance computing. These components will interact in complex ways, therefore coupling them needs to be programmed. Programming in the large, on top of existing applications, enables us to build much more capable applications and to productively manage this complexity.

Related