2020/05/31 by Christian Göttel, Lars Nielsen, Lars B. Nielsen +4 · 7 citations
Computer Science · Engineering · #Caching and Content Delivery #Cloud computing #Computer network #Computer science #Computer security #Context (archaeology) #Data deduplication #Database #Engineering #Footprint #Internet of Things #IoT and Edge/Fog Computing #Limiting #Operating system #Opportunistic and Delay-Tolerant Networks #cs.DC
paper · pdf · doi:10.1145/3401025.3404098
published as DEBS'20: Proceedings of the 14th ACM International Conference on Distributed and Event-Based Systems (2020) 133-136 · This work was partially financed by the SCALE-IoT Project (Grant No. 7026-00042B) granted by the Independent Research Fund Denmark, by the Aarhus Universitets Forskningsfond (AUFF) Starting Grant Project AUFF- 2017-FLS-7-1, and Aarhus University's DIGIT Centre. European Commission Project: LEGaTO - Low Energy Toolset for Heterogeneous Computing (EC-H2020-780681)
openalex created_date 2020/05/29 · openalex publication_date 2020/07/13 · arxiv created 2020/07/20 · arxiv updated 2020/07/21 · openalex updated_date 2026/08/05
The Internet of Things (IoT) is connecting a massive number of devices that generate a growing amount of data to be transmitted over the network. This traffic growth is expected to continue. Generalized deduplication (GD) is a novel technique to effectively compress the data to (a) reduce the data storage cost by identifying similar data chunks, and (b) reduce the pressure on the network infrastructure. This paper presents Hermes, an application-level protocol for the data-plane that can operate using GD as well as classic deduplication. Hermes significantly reduces the data transmission traffic while effectively decreasing the energy footprint, a key goal in many IoT deployments. We fully implemented Hermes, evaluated its performance using consumer-grade IoT devices (e.g., Raspberry Pi 4B), and highlighted key tradeoffs to be considered to manage real-world workloads. Several fold to several order of magnitude gains over standard compressors and deduplication are achievable.