2005/04/13 by Tassos Argyros, Tassos S. Argyros, Argyros, Tassos S. +2
Computer Science · #Cloud Computing and Resource Management #Data Mining Algorithms and Applications #Distributed and Parallel Computing Systems #cs.DB #cs.DC #cs.NI #cs.OS #cs.PL
paper · pdf · doi:10.48550/arxiv.cs/0504051
arxiv created 2005/04/13 · arxiv updated 2009/12/01
This paper presents a stream-oriented architecture for structuring cluster applications. Clusters that run applications based on this architecture can scale to tenths of thousands of nodes with significantly less performance loss or reliability problems. Our architecture exploits the stream nature of the data flow and reduces congestion through load balancing, hides latency behind data pushes and transparently handles node failures. In our ongoing work, we are developing an implementation for this architecture and we are able to run simple data mining applications on a cluster simulator.