- Efficient Memory Management for Large Language Model Serving with PagedAttention
2023/09/12 by Woosuk Kwon, Kwon, Woosuk, Zhuohan Li +15 · 4 voices · 2247 citations
Computer Science · #CPU cache #Cache #Cache algorithms #Cache coloring #Cache pollution #Caching and Content Delivery #Computer network #Computer science #Demand paging #Latency (audio) #Memory management #Operating system #Overlay #Page cache #Paging #Parallel computing #Software System Performance and Reliability #Topic Modeling #Virtual memory #cs.DC #cs.LG
- Reuse Distance-based Copy-backs of Clean Cache Lines to Lower-level Caches
2021/05/30 by Rui Wang, Chundong Wang, Wang, Rui +3 · 3 voices
Computer Science · Engineering · #Advanced Data Storage Technologies #Bus sniffing #CPU cache #Cache #Cache algorithms #Cache coloring #Cache invalidation #Cache pollution #Computer science #Copying #Distributed systems and fault tolerance #Engineering #Operating system #Page cache #Parallel Computing and Optimization Techniques #Parallel computing #Political science #Reuse #Smart Cache
- TimeCache: Using Time to Eliminate Cache Side Channels when Sharing Software
2020/09/30 by Divya Ojha, Sandhya Dwarkadas · 1 voice
Computer Science · #Advanced Malware Detection Techniques #Bus sniffing #CPU cache #Cache #Cache algorithms #Cache coloring #Cache invalidation #Cache pollution #Computer network #Computer science #Computer security #Cryptographic Implementations and Security #Cryptography #Embedded system #Operating system #Page cache #Parallel computing #Security and Verification in Computing #Side channel attack #Smart Cache #cs.CR
- A Cache Architecture for Counting Bloom Filters
2007/11/01 by Mahmood Ahmadi, Stephan Wong · 1 citation
Computer Science · Materials Science · #Caching and Content Delivery #Network Packet Processing and Optimization #Covalent Organic Framework Applications #Bloom filter #Computer science #Cache #Cache pollution #Page cache #Cache algorithms #Cache-only memory architecture #Parallel computing #Cache coloring #CPU cache #Network packet #Computer hardware #Computer network
- Summary cache: a scalable wide-area Web cache sharing protocol
2000/06/01 by Li Fan, Pei Cao, Jussara M. Almeida +1 · 14 citations
Computer Science · #Caching and Content Delivery #Advanced Data Storage Technologies #Network Packet Processing and Optimization #Computer science #Cache #Cache invalidation #MESI protocol #Cache algorithms #Smart Cache #Computer network #Cache pollution #Bus sniffing #Cache coloring #Page cache #Distributed computing #CPU cache
- Design of the IBM Enterprise System/9000 high-end processor
1992/07/01 by J. S. Liptay · 1 citation
Computer Science · #Parallel Computing and Optimization Techniques #Interconnection Networks and Systems #Distributed and Parallel Computing Systems #Computer science #Cache #Cache algorithms #IBM #Operating system #Parallel computing #Cache coloring #Cache pollution #Operand #Table (database) #CPU cache #Page cache #Database
- Motorola's 88000 family architecture
1990/06/01 by Mitch Alsup · 1 citation
Computer Science · #Parallel Computing and Optimization Techniques #Embedded Systems Design Techniques #Advanced Data Storage Technologies #Computer science #Cache #Operating system #Parallel computing #Cache-only memory architecture #CPU cache #Cache pollution #Cache coloring #Cache algorithms #Page cache #Compiler