2015/05/07 by Teng Wang, Sarp Oral, Wang, Teng +7
Computer Science · #Advanced Data Storage Technologies #Distributed #Distributed and Parallel Computing Systems #FOS: Computer and information sciences #Operating Systems (cs.OS) #Parallel #Peer-to-Peer Network Technologies #and Cluster Computing (cs.DC) #cs.DC #cs.OS
paper · pdf · doi:10.48550/arxiv.1505.01765
International Workshop on the Lustre Ecosystem: Challenges and Opportunities, March 2015, Annapolis MD
arxiv created 2015/05/07 · openalex publication_date 2015/05/07 · arxiv updated 2015/05/08 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28
Modern parallel filesystems such as Lustre are designed to provide high, scalable I/O bandwidth in response to growing I/O requirements; however, the bursty I/O characteristics of many data-intensive scientific applications make it difficult for back-end parallel filesystems to efficiently handle I/O requests. A burst buffer system, through which data can be temporarily buffered via high-performance storage mediums, allows for gradual flushing of data to back-end filesystems. In this paper, we explore issues surrounding the development of a burst buffer system for data-intensive scientific applications. Our initial results demonstrate that utilizing a burst buffer system on top of the Lustre filesystem shows promise for dealing with the intense I/O traffic generated by application checkpointing.