2012/01/01 by Matteo Frigo, Charles E. Leiserson, Harald Prokop +1 · 2 citations
Computer Science · #Algorithm #Algorithms and Data Compression #CPU cache #Cache #Cache algorithms #Cache coloring #Cache invalidation #Cache-oblivious algorithm #Computer science #Optimization and Search Problems #Parallel Computing and Optimization Techniques #Parallel computing #Smart Cache #Sorting #Transpose
paper · doi:10.1145/2071379.2071383
openalex publication_date 2012/01/01 · openalex created_date 2025/10/10 · openalex updated_date 2026/08/06
This article presents asymptotically optimal algorithms for rectangular matrix transpose, fast Fourier transform (FFT), and sorting on computers with multiple levels of caching. Unlike previous optimal algorithms, these algorithms are cache oblivious : no variables dependent on hardware parameters, such as cache size and cache-line length, need to be tuned to achieve optimality. Nevertheless, these algorithms use an optimal amount of work and move data optimally among multiple levels of cache. For a cache with size M and cache-line length B where M = Ω ( B 2 ), the number of cache misses for an m × n matrix transpose is Θ (1 + mn / B ). The number of cache misses for either an n -point FFT or the sorting of n numbers is Θ (1 + ( n / B )(1 + log M n )). We also give a Θ ( mnp )-work algorithm to multiply an m × n matrix by an n × p matrix that incurs Θ (1 + ( mn + np + mp )/ B + mnp / B √ M ) cache faults. We introduce an “ideal-cache” model to analyze our algorithms. We prove that an optimal cache-oblivious algorithm designed for two levels of memory is also optimal for multiple levels and that the assumption of optimal replacement in the ideal-cache model can be simulated efficiently by LRU replacement. We offer empirical evidence that cache-oblivious algorithms perform well in practice.