vix.ing · top · new · best · stats

Roomy: A System for Space Limited Computations

2010/06/09 by Daniel Kunkle, Kunkle, Daniel
Computer Science · #Advanced Data Storage Technologies #Distributed #Distributed and Parallel Computing Systems #Distributed systems and fault tolerance #FOS: Computer and information sciences #Parallel #and Cluster Computing (cs.DC) #cs.DC

paper · pdf · doi:10.48550/arxiv.1006.1926

arxiv created 2010/06/09 · openalex publication_date 2010/06/09 · arxiv updated 2010/06/11 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

There are numerous examples of problems in symbolic algebra in which the required storage grows far beyond the limitations even of the distributed RAM of a cluster. Often this limitation determines how large a problem one can solve in practice. Roomy provides a minimally invasive system to modify the code for such a computation, in order to use the local disks of a cluster or a SAN as a transparent extension of RAM. Roomy is implemented as a C/C++ library. It provides some simple data structures (arrays, unordered lists, and hash tables). Some typical programming constructs that one might employ in Roomy are: map, reduce, duplicate elimination, chain reduction, pair reduction, and breadth-first search. All aspects of parallelism and remote I/O are hidden within the Roomy library.

Related