- ZSMerge: Zero-Shot KV Cache Compression for Memory-Efficient Long-Context LLMs
2025/03/13 by Xin Liu, Xudong Wang, Liu, Xin +5 · 7 voices · 2 citations
Computer Science · #Big Data and Digital Economy #CPU cache #Cache #Cache algorithms #Cache coloring #Cache-only memory architecture #Context (archaeology) #Memory footprint #Natural Language Processing Techniques #Parallel Computing and Optimization Techniques #Security token #cs.AI #cs.CL
- Efficient Memory Management for Large Language Model Serving with PagedAttention
2023/09/12 by Woosuk Kwon, Zhuohan Li, Kwon, Woosuk +15 · 4 voices · 2247 citations
Computer Science · #CPU cache #Cache #Cache algorithms #Cache coloring #Cache pollution #Caching and Content Delivery #Computer network #Computer science #Demand paging #Latency (audio) #Memory management #Operating system #Overlay #Page cache #Paging #Parallel computing #Software System Performance and Reliability #Topic Modeling #Virtual memory #cs.DC #cs.LG
- On-Demand AoI Minimization in Resource-Constrained Cache-Enabled IoT Networks with Energy Harvesting Sensors
2022/01/28 by M. Hatami, Markus Leinonen, Hatami, Mohammad +7 · 2 citations
Computer Science · Engineering · Mathematics · Medicine · #Age of Information Optimization #Algorithm #Asymptotically optimal algorithm #CPU cache #Cache #Computer network #Computer science #Congenital Heart Disease Studies #Distributed computing #Energy (signal processing) #Enhanced Data Rates for GSM Evolution #FOS: Computer and information sciences #FOS: Electrical engineering #Information Theory (cs.IT) #IoT Networks and Protocols #Markov decision process #Markov process #Mathematical optimization #Mathematics #Networking and Internet Architecture (cs.NI) #Node (physics) #Real-time computing #Signal Processing (eess.SP) #Systems and Control (eess.SY) #Transmission (telecommunications) #Wireless sensor network #electronic engineering #information engineering
- Reuse Distance-based Copy-backs of Clean Cache Lines to Lower-level Caches
2021/05/30 by Rui Wang, Chundong Wang, Wang, Rui +3 · 3 voices
Computer Science · Engineering · #Advanced Data Storage Technologies #Bus sniffing #CPU cache #Cache #Cache algorithms #Cache coloring #Cache invalidation #Cache pollution #Computer science #Copying #Distributed systems and fault tolerance #Engineering #Operating system #Page cache #Parallel Computing and Optimization Techniques #Parallel computing #Political science #Reuse #Smart Cache
- TimeCache: Using Time to Eliminate Cache Side Channels when Sharing Software
2020/09/30 by Divya Ojha, Sandhya Dwarkadas · 1 voice
Computer Science · #Advanced Malware Detection Techniques #Bus sniffing #CPU cache #Cache #Cache algorithms #Cache coloring #Cache invalidation #Cache pollution #Computer network #Computer science #Computer security #Cryptographic Implementations and Security #Cryptography #Embedded system #Operating system #Page cache #Parallel computing #Security and Verification in Computing #Side channel attack #Smart Cache #cs.CR
- BLADE: An in-Cache Computing Architecture for Edge Devices
2020/02/11 by William Andrew Simon, William Simon, Yasir Mahmood Qureshi +4 · 3 citations
Computer Science · Engineering · #Abstraction #Advanced Data Storage Technologies #Advanced Memory and Neural Computing #CPU cache #Cache #Cloud computing #Computer architecture #Computer hardware #Computer science #Context (archaeology) #Edge device #Electrical engineering #Embedded system #Energy consumption #Engineering #Operating system #Overhead (engineering) #Parallel Computing and Optimization Techniques #Parallel computing #Static random-access memory
- Appearances of the Birthday Paradox in High Performance Computing
2019/09/26 by Victor Eijkhout, Eijkhout, Victor, Margaret Myers +3 · 2 citations
Computer Science · Engineering · #A priori and a posteriori #CPU cache #Cache #Cloud Computing and Resource Management #Computer science #Distributed and Parallel Computing Systems #Distributed computing #Engineering #Epistemology #FOS: Computer and information sciences #Hardware Architecture (cs.AR) #Parallel computing #Phenomenon #Port (circuit theory) #Quantum Computing Algorithms and Architecture #Theoretical computer science
- MeltdownPrime and SpectrePrime: Automatically-Synthesized Attacks Exploiting Invalidation-Based Coherence Protocols
2018/02/11 by Caroline Trippel, Daniel Lustig, Trippel, Caroline +3 · 8 voices · 6 citations
Computer Science · Engineering · #Artificial intelligence #CPU cache #Cache #Cache algorithms #Cache coherence #Computer science #Computer security #Embedded system #Exploit #Leverage (statistics) #Microarchitecture #Parallel computing #Radiation Effects in Electronics #Security and Verification in Computing #Semiconductor materials and devices #cs.AR #cs.CR
- Robust and Efficient Elimination of Cache and Timing Side Channels
2015/05/31 by Benjamin Braun, Benjamin A. Braun, Suman Jana +4 · 4 voices · 5 citations
Computer Science · #CPU cache #Cache #Cache algorithms #Cache invalidation #Code (set theory) #Computer network #Computer science #Computer security #Cryptographic Implementations and Security #Cryptography #Embedded system #Implementation #Operating system #Overhead (engineering) #Parallel computing #Physical Unclonable Functions (PUFs) and Hardware Security #Programming language #Security and Verification in Computing #Set (abstract data type) #Side channel attack #Timing attack #cs.CR
- Fundamental Limits of Caching With Secure Delivery
2013/12/31 by Avik Sengupta, Ravi Tandon, T. Charles Clancy · 1 citation
Computer Science · Mathematics · #CPU cache #Cache #Caching and Content Delivery #Computer network #Computer science #Content delivery #Cooperative Communication and Network Coding #Distributed computing #Leverage (statistics) #Operating system #Opportunistic and Delay-Tolerant Networks #Wireless #cs.IT #cs.NI #math.IT
- The Cost of Address Translation
2012/12/04 by Tomasz Jurkiewicz, Kurt Mehlhorn, Jurkiewicz, Tomasz +1 · 2 voices
Computer Science · Mathematics · #Advanced Data Storage Technologies #Algorithm #Arithmetic #Binary number #Binary translation #CPU cache #Cache #Computer science #Distributed and Parallel Computing Systems #Hierarchy #Mathematics #Memory hierarchy #Memory management #Overlay #Parallel Computing and Optimization Techniques #Parallel computing #Physical address #Point (geometry) #Programming language #Simple (philosophy) #Theoretical computer science #Translation (biology) #Translation lookaside buffer #Virtual memory #acm:03D15 #acm:68Q05 #acm:68Q15 #cs.CC #cs.DS #cs.PF #msc:03D15 #msc:68Q05 #msc:68Q15
- Cache-Oblivious Algorithms
2012/01/01 by Matteo Frigo, Charles E. Leiserson, Harald Prokop +1 · 1 citation
Computer Science · #Parallel Computing and Optimization Techniques #Optimization and Search Problems #Algorithms and Data Compression #Cache algorithms #Cache #Cache-oblivious algorithm #Computer science #Parallel computing #Algorithm #Transpose #Cache coloring #Cache invalidation #CPU cache #Smart Cache #Sorting
- A Cache Architecture for Counting Bloom Filters
2007/11/01 by Mahmood Ahmadi, Stephan Wong · 1 citation
Computer Science · Materials Science · #Caching and Content Delivery #Network Packet Processing and Optimization #Covalent Organic Framework Applications #Bloom filter #Computer science #Cache #Cache pollution #Page cache #Cache algorithms #Cache-only memory architecture #Parallel computing #Cache coloring #CPU cache #Network packet #Computer hardware #Computer network
- Summary cache: a scalable wide-area Web cache sharing protocol
2000/06/01 by Li Fan, Pei Cao, Jussara M. Almeida +1 · 14 citations
Computer Science · #Caching and Content Delivery #Advanced Data Storage Technologies #Network Packet Processing and Optimization #Computer science #Cache #Cache invalidation #MESI protocol #Cache algorithms #Smart Cache #Computer network #Cache pollution #Bus sniffing #Cache coloring #Page cache #Distributed computing #CPU cache
- The microarchitecture of superscalar processors
1995/01/01 by James E. Smith, Gurindar S. Sohi · 1 citation
Computer Science · #Parallel Computing and Optimization Techniques #Distributed and Parallel Computing Systems #Embedded Systems Design Techniques #Superscalar #Computer science #Parallel computing #Microarchitecture #Instruction-level parallelism #Speculative execution #Process (computing) #Out-of-order execution #Instructions per cycle #Pipeline burst cache #Parallelism (grammar) #Computer architecture #Computer hardware #Operating system #CPU cache #Cache
- The effect of code expanding optimizations on instruction cache design
1993/01/01 by W.Y. Chen, Pohua P. Chang, Thomas M. Conte +1 · 1 citation
Computer Science · #Parallel Computing and Optimization Techniques #Advanced Data Storage Technologies #Cloud Computing and Resource Management #Computer science #Cache #Parallel computing #Code (set theory) #Function (biology) #Cache algorithms #Scheme (mathematics) #CPU cache #Programming language
- Design of the IBM Enterprise System/9000 high-end processor
1992/07/01 by J. S. Liptay · 1 citation
Computer Science · #Parallel Computing and Optimization Techniques #Interconnection Networks and Systems #Distributed and Parallel Computing Systems #Computer science #Cache #Cache algorithms #IBM #Operating system #Parallel computing #Cache coloring #Cache pollution #Operand #Table (database) #CPU cache #Page cache #Database
- Motorola's 88000 family architecture
1990/06/01 by Mitch Alsup · 1 citation
Computer Science · #Parallel Computing and Optimization Techniques #Embedded Systems Design Techniques #Advanced Data Storage Technologies #Computer science #Cache #Operating system #Parallel computing #Cache-only memory architecture #CPU cache #Cache pollution #Cache coloring #Cache algorithms #Page cache #Compiler