2025/03/12 by Aparna Sasidharan, Sasidharan, Aparna, Xian-He +4
Computer Science · #Advanced Data Storage Technologies #Caching and Content Delivery #Distributed #Distributed and Parallel Computing Systems #FOS: Computer and information sciences #Parallel #and Cluster Computing (cs.DC)
paper · pdf · doi:10.48550/arxiv.2503.08966
openalex publication_date 2025/03/12 · openalex created_date 2025/10/13 · openalex updated_date 2026/07/28
This work describes the design, implementation and performance analysis of a distributed two-tiered storage software. The first tier functions as a distributed software cache implemented using solid-state devices~(NVMes) and the second tier consists of multiple hard disks~(HDDs). We describe an online learning algorithm that manages data movement between the tiers. The software is hybrid, i.e. both distributed and multi-threaded. The end-to-end performance model of the two-tier system was developed using queuing networks and behavioral models of storage devices. We identified significant parameters that affect the performance of storage devices and created behavioral models for each device. The performance of the software was evaluated on a many-core cluster using non-trivial read/write workloads. The paper provides examples to illustrate the use of these models.