vix.ing · top · new · best · stats · spec

Taurus: Lightweight Parallel Logging for In-Memory Database Management Systems (Extended Version)

2020/10/14 by Yu Xia, Xiangyao Yu, Xia, Yu +5 · 1 voice
Computer Science · #Advanced Data Storage Technologies #Cloud Computing and Resource Management #Databases (cs.DB) #Distributed systems and fault tolerance #FOS: Computer and information sciences #cs.DB

paper · pdf · doi:10.48550/arxiv.2010.06760

openalex publication_date 2020/10/14 · arxiv published 2020/10/14 · arxiv updated 2020/10/14 · openalex created_date 2020/10/22 · openalex updated_date 2026/07/28

Abstract

Existing single-stream logging schemes are unsuitable for in-memory database management systems (DBMSs) as the single log is often a performance bottleneck. To overcome this problem, we present Taurus, an efficient parallel logging scheme that uses multiple log streams, and is compatible with both data and command logging. Taurus tracks and encodes transaction dependencies using a vector of log sequence numbers (LSNs). These vectors ensure that the dependencies are fully captured in logging and correctly enforced in recovery. Our experimental evaluation with an in-memory DBMS shows that Taurus's parallel logging achieves up to 9.9x and 2.9x speedups over single-streamed data logging and command logging, respectively. It also enables the DBMS to recover up to 22.9x and 75.6x faster than these baselines for data and command logging, respectively. We also compare Taurus with two state-of-the-art parallel logging schemes and show that the DBMS achieves up to 2.8x better performance on NVMe drives and 9.2x on HDDs.

Citations

Discussions

Related