vix.ing · top · new · best · stats · spec

Synchronizing Many Filesystems in Near Linear Time

2023/02/19 by Elod P. Csirmaz, Csirmaz, Elod P., László Csirmaz +1
Computer Science · #08A02 #08A70 #68M07 #68P05 #Advanced Database Systems and Queries #D.4.3 #Distributed systems and fault tolerance #E.5 #F.2.2 #FOS: Computer and information sciences #G.2 #Information Theory (cs.IT) #Parallel Computing and Optimization Techniques

paper · pdf · doi:10.48550/arxiv.2302.09666

openalex publication_date 2023/02/19 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

Finding a provably correct subquadratic synchronization algorithm for many filesystem replicas is one of the main theoretical problems in Operational Transformation (OT) and Conflict-free Replicated Data Types (CRDT) frameworks. Based on the Algebraic Theory of Filesystems, which incorporates non-commutative filesystem commands natively, we developed and built a proof-of-concept implementation of an algorithm suite which synchronizes an arbitrary number of replicas. The result is provably correct, and the synchronized system is created in linear space and time after an initial sorting phase. It works by identifying conflicting command pairs and requesting one of the commands to be removed. The method can be guided to reach any of the theoretically possible synchronized states. The algorithm also allows asynchronous usage. After the client sends a synchronization request, the local replica remains available for further modifications. When the synchronization instructions arrive, they can be merged with the changes made since the synchronization request. The suite also works on filesystems with directed acyclic graph-based path structure in place of the traditional tree-like arrangement. Consequently, our algorithms apply to filesystems with hard or soft links as long as the links create no loops.

Related