vix.ing · top · new · best · stats

Flex: Closing the Gaps between Usage and Allocation

2020/06/02 by Tan N. Le, Zhenhua Liu, Le, Tan N. +1
Computer Science · #Business #Closing (real estate) #Cloud Computing and Resource Management #Computer science #Distributed #Distributed and Parallel Computing Systems #FLEX #FOS: Computer and information sciences #Finance #IoT and Edge/Fog Computing #Networking and Internet Architecture (cs.NI) #Operating Systems (cs.OS) #Parallel #Telecommunications #and Cluster Computing (cs.DC) #cs.DC #cs.NI #cs.OS

paper · pdf · doi:10.48550/arxiv.2006.01354

published in arXiv (Cornell University) (Cornell University)

arxiv created 2020/06/02 · openalex publication_date 2020/06/02 · arxiv updated 2020/06/03 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

Data centers are giant factories of Internet data and services. Worldwide data centers consume energy and emit emissions more than airline industry. Unfortunately, most of data centers are significantly underutilized. One of the major reasons is the big gaps between the real usage and the provisioned resources because users tend to over-estimate their demand and data center operators often rely on users' requests for resource allocation. In this paper, we first conduct an in-depth analysis of a Google cluster trace to unveil the root causes for low utilization and highlight the great potential to improve it. We then developed an online resource manager Flex to maximize the cluster utilization while satisfying the Quality of Service (QoS). Large-scale evaluations based on real-world traces show that Flex admits up to 1.74x more requests and 1.6x higher utilization compared to tradition schedulers while maintaining the QoS.

Related