2020/05/08 by S. Vignesh, S., Vignesh, V. Muthumanikandan +5
Computer Science · #Advanced Data Storage Technologies #Cloud Computing and Resource Management #Distributed #FOS: Computer and information sciences #Graph Theory and Algorithms #Parallel #and Cluster Computing (cs.DC)
paper · pdf · doi:10.48550/arxiv.2005.07600
openalex publication_date 2020/05/08 · openalex created_date 2020/07/02 · openalex updated_date 2026/07/28
MapReduce is a technique used to vastly improve distributed processing of data and can massively speed up computation. Hadoop and its MapReduce relies on JVM and Java which is expensive on memory. High Performance Computing based MapReduce framework could be used that can perform more memory-efficiently and faster than the standard MapReduce. This paper explores an entirely C++ based approach to the MapReduce and its feasibility on multiple factors like developer friendliness, deployment interface, efficiency and scalability. This paper also introduces Delayed Reduction and deployment techniques that can speed up MapReduce in a compiled environment.