vix.ing · top · new · best · stats · spec

Finishing Flows Quickly with Preemptive Scheduling

2012/06/10 by Chi-Yao Hong, Hong, Chi-Yao, Matthew Caesar +3
Computer Science · #Cloud Computing and Resource Management #FOS: Computer and information sciences #Network Traffic and Congestion Control #Networking and Internet Architecture (cs.NI) #Peer-to-Peer Network Technologies #cs.NI

paper · pdf · doi:10.48550/arxiv.1206.2057

The conference version was published in SIGCOMM 2012

openalex publication_date 2012/06/10 · arxiv created 2012/06/12 · arxiv updated 2012/06/13 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

Today's data centers face extreme challenges in providing low latency. However, fair sharing, a principle commonly adopted in current congestion control protocols, is far from optimal for satisfying latency requirements. We propose Preemptive Distributed Quick (PDQ) flow scheduling, a protocol designed to complete flows quickly and meet flow deadlines. PDQ enables flow preemption to approximate a range of scheduling disciplines. For example, PDQ can emulate a shortest job first algorithm to give priority to the short flows by pausing the contending flows. PDQ borrows ideas from centralized scheduling disciplines and implements them in a fully distributed manner, making it scalable to today's data centers. Further, we develop a multipath version of PDQ to exploit path diversity. Through extensive packet-level and flow-level simulation, we demonstrate that PDQ significantly outperforms TCP, RCP and D3 in data center environments. We further show that PDQ is stable, resilient to packet loss, and preserves nearly all its performance gains even given inaccurate flow information.

Related