2016/08/20 by Marius Poke, Torsten Hoefler, Poke, Marius +3 · 1 voice · 2 citations
Computer Science · #Atomic broadcast #Bottleneck #Broadcasting (networking) #Cloud Computing and Resource Management #Computer network #Computer science #Distributed computing #Distributed systems and fault tolerance #Embedded system #Fault tolerance #InfiniBand #Latency (audio) #Operating system #Overlay #Overlay network #Protocol (science) #Scalability #Software System Performance and Reliability #Telecommunications #Throughput #Wireless #cs.DC
paper · pdf · doi:10.48550/arxiv.1608.05866
published in arXiv (Cornell University) (Cornell University) · Overview: 18 pages, 7 sections, 10 figures, 3 tables. Modifications from previous version: added Figure 4; added, in Section 4.4, a paragraph describing the construction of Gs digraphs; added Section 4.5, a theoretical comparison between AllConcur and leader-based agreement; added, in Section 5, a comparison to unreliable agreement; rephrased several paragraphs to improve clarity
openalex publication_date 2016/08/20 · arxiv created 2017/04/21 · arxiv updated 2017/04/24 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28
Many distributed systems require coordination between the components involved. With the steady growth of such systems, the probability of failures increases, which necessitates scalable fault-tolerant agreement protocols. The most common practical agreement protocol, for such scenarios, is leader-based atomic broadcast. In this work, we propose AllConcur, a distributed system that provides agreement through a leaderless concurrent atomic broadcast algorithm, thus, not suffering from the bottleneck of a central coordinator. In AllConcur, all components exchange messages concurrently through a logical overlay network that employs early termination to minimize the agreement latency. Our implementation of AllConcur supports standard sockets-based TCP as well as high-performance InfiniBand Verbs communications. AllConcur can handle up to 135 million requests per second and achieves 17x higher throughput than today's standard leader-based protocols, such as Libpaxos. Thus, AllConcur is highly competitive with regard to existing solutions and, due to its decentralized approach, enables hitherto unattainable system designs in a variety of fields.