PUL: Pre-load in Software for Caches Wouldn't Always Play Along

2025/06/20 by Bernhardt, Arthur, Tamimi, Sajjad, Stock, Florian +2
Computer Science · #Advanced Data Storage Technologies #Cloud Computing and Resource Management #Databases (cs.DB) #FOS: Computer and information sciences #Parallel Computing and Optimization Techniques

paper · pdf · doi:10.48550/arxiv.2506.16976

openalex publication_date 2025/06/20 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

Memory latencies and bandwidth are major factors, limiting system performance and scalability. Modern CPUs aim at hiding latencies by employing large caches, out-of-order execution, or complex hardware prefetchers. However, software-based prefetching exhibits higher efficiency, improving with newer CPU generations. In this paper we investigate software-based, post-Moore systems that offload operations to intelligent memories. We show that software-based prefetching has even higher potential in near-data processing settings by maximizing compute utilization through compute/IO interleaving.

Citations

• Shuhai: A Tool for Benchmarking High Bandwidth Memory on FPGAs
• Persistent Memory I/O Primitives
• Basic Performance Measurements of the Intel Optane DC Persistent Memory Module

Related

• Pickle: Precise, Flexible Cross-Core Last-level Cache Data Prefetching for Irregular Memory Accesses
• Data Cache Prefetching with Perceptron Learning
• A Survey on Recent Hardware Data Prefetching Approaches with An Emphasis on Servers
• MERE: Hardware-Software Co-Design for Masking Cache Miss Latency in Embedded Processors
• Choreographer: A Full-System Framework for Fine-Grained Tasks in Cache Hierarchies